-- Logs begin at Thu 2022-05-26 20:11:10 UTC, end at Thu 2022-05-26 22:13:49 UTC. -- May 26 21:11:41.803864 dv-cinder-828807-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 21:11:41.813481 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 21:11:41 2022] *** May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: nodename: dv-cinder-828807-3-iscsi May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: machine: x86_64 May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: clock source: unix May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: pcre jit disabled May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: detected number of CPU cores: 4 May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: current working directory: / May 26 21:11:41.815062 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: detected binary path: /usr/bin/uwsgi-core May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: your processes number limit is 47680 May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: your memory page size is 4096 bytes May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: detected max file descriptor number: 2048 May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: lock engine: pthread robust mutexes May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: thunder lock: enabled May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 21:11:41.815755 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 21:11:41.860546 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: Python main interpreter initialized at 0x5633641b49c0 May 26 21:11:41.860546 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: python threads support enabled May 26 21:11:41.860546 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: your server socket listen backlog is limited to 100 connections May 26 21:11:41.860546 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: your mercy for graceful operations on workers is 90 seconds May 26 21:11:41.861003 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: mapped 403077 bytes (393 KB) for 2 cores May 26 21:11:41.861003 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: *** Operational MODE: preforking *** May 26 21:11:41.861288 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: *** uWSGI is running in multiple interpreter mode *** May 26 21:11:41.861288 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: spawned uWSGI master process (pid: 103891) May 26 21:11:41.861509 dv-cinder-828807-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 21:11:41.862098 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: spawned uWSGI worker 1 (pid: 103892, cores: 1) May 26 21:11:41.864621 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: spawned uWSGI worker 2 (pid: 103893, cores: 1) May 26 21:11:41.864621 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 21:11:43.041446 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:11:43.054042 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:11:43.767316 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:11:43.767316 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: from cryptography.utils import int_from_bytes May 26 21:11:43.767646 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:11:43.767646 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: from cryptography.utils import int_from_bytes May 26 21:11:43.772327 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:11:43.772327 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: from cryptography.utils import int_from_bytes May 26 21:11:43.772683 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:11:43.772683 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: from cryptography.utils import int_from_bytes May 26 21:11:46.372409 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:11:46.373115 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:11:46.373215 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:11:46.373563 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:11:46.373824 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:11:46.374213 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.374543 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.374866 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.375187 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.375524 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.375839 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.376162 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.376488 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.376854 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.383494 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.383592 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:11:46.383987 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384065 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:11:46.384137 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-3-iscsi {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384203 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:11:46.384277 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384351 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:11:46.384423 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384495 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:11:46.384560 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384678 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384756 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384823 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384902 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.384968 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385032 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385182 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385263 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385334 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385406 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385487 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385487 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385624 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385690 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385753 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385822 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385889 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.385889 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386081 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386144 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386213 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386287 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-3-iscsi {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386366 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386436 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386501 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386635 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386710 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386710 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386826 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386896 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.386970 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-3-iscsi {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387041 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387117 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387182 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387251 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387251 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387387 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387387 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387523 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387589 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387658 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387736 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387802 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387866 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387930 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.387993 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388056 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388127 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388203 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388273 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388344 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388416 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388511 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388621 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388719 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388797 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388873 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.388972 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-3-iscsi {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389044 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389044 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389175 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389175 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389299 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389365 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389429 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389675 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389772 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.389952 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390030 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390204 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390348 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390513 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390615 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390837 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.390927 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391160 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391249 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391486 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391587 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391740 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391836 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.391993 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392126 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392313 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392444 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392658 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392777 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.392970 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393074 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393326 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393421 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393636 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393730 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.393950 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394096 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394248 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394343 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394541 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394667 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394847 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.394988 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395164 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395285 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395479 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395608 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395795 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.395927 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396043 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396251 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396347 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396561 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396689 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.396929 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397231 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397318 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397536 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397637 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397836 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.397924 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398139 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398238 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398441 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398539 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398743 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.398831 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399043 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399178 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399344 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399442 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399656 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399754 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.399992 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.400091 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.400307 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.400396 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.400632 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.400737 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401046 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401137 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401357 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401446 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401610 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401705 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.401927 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402102 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402218 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402319 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402540 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402629 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402848 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.402946 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403156 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403244 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403464 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403552 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403768 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.403864 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404086 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404182 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404374 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404471 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404702 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.404809 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405012 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405108 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405316 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405404 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405562 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405731 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405891 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.405987 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.406198 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.406285 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.406512 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.406618 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407539 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407634 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407721 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407812 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407903 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.407984 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408069 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408150 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408235 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408320 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408410 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408499 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408626 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408728 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408856 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.408952 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409157 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409245 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409459 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409551 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409761 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.409850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410062 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410151 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410361 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410500 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410672 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410813 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.410987 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411124 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411288 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411445 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411589 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411747 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.411897 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.412058 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.412184 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.412379 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413027 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413233 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413335 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413544 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413639 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413852 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.413947 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414165 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414300 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414471 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414559 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414780 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.414870 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415085 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415181 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415383 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415477 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415685 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415779 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.415981 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416069 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416283 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416371 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416639 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416739 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.416948 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417038 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417250 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417339 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417548 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417695 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417847 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.417937 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.418145 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.418233 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.418451 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.418553 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.418748 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.418836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.419047 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.419171 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.419340 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.419510 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.419652 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.419836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.419965 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.420154 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.420271 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.420473 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.420570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.420831 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.420921 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.421147 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.421245 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:11:46.421462 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.421551 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.421811 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.421902 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422251 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422460 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422556 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422790 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.422885 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423112 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423209 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423428 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423517 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423736 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.423824 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.424045 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.424394 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.424640 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.424752 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.424952 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425041 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425260 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425364 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425567 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425664 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425882 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.425969 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426194 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426518 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426606 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426832 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.426920 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427145 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427237 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427458 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427547 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427765 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.427854 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.428077 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.428197 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429016 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429109 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429343 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429470 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429654 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429756 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.429993 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430083 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430322 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430409 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430631 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430720 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.430943 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431035 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431255 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431355 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431655 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431877 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.431966 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432187 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432285 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432507 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432647 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.432944 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433156 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433253 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433470 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433558 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433777 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.433872 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434086 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434188 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434394 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434485 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434701 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.434795 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435005 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435094 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435315 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435404 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435623 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435711 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.435933 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436022 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436239 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436328 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436548 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436655 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436876 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.436974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437181 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437277 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437485 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437573 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437784 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.437881 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438084 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438172 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438384 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438473 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438693 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.438790 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439004 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439098 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439313 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439411 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439640 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439729 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.439955 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440043 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440265 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440367 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440602 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440694 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.440918 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441020 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441223 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441322 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441531 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441620 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441832 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.441920 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442139 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442446 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442535 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442747 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.442836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443066 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443157 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443373 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443468 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443673 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.443789 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444013 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444111 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444312 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444401 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444631 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444738 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.444941 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445038 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445247 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445336 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445587 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445688 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445893 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.445983 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446199 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446287 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446516 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446614 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446823 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.446910 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447127 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447214 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447437 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447534 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447745 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.447834 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448051 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448142 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448356 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448454 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448779 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.448997 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449084 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449296 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449386 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449602 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449698 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449903 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.449994 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450205 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450294 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450502 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450591 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450806 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.450903 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451104 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451200 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451401 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451530 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451698 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451868 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.451994 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452191 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452286 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452519 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452643 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452862 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.452960 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453183 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453272 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453478 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453565 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453776 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.453866 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454095 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454183 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454400 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454494 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454736 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.454825 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455066 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455380 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455469 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455697 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.455787 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456005 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456093 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456316 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456411 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456642 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456737 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.456950 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457040 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457254 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457352 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457559 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457647 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457873 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.457962 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458195 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458295 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458492 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458587 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458804 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.458892 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459122 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459230 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459492 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459584 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459805 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.459947 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460106 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460204 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460418 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460506 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460763 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.460851 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461079 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461176 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461393 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461482 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461706 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.461793 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462016 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462112 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462327 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462416 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462633 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462734 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.462966 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463056 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463270 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463359 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463575 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463663 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463890 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.463987 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464196 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464283 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464510 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464652 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464842 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.464932 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465161 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465248 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465465 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465562 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465776 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.465863 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466075 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466163 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466381 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466485 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466695 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.466783 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467011 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467100 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467315 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467412 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467621 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467710 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.467926 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468012 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468230 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468326 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468542 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468645 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468870 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.468974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469171 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469267 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469471 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469567 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469777 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.469865 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470085 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470174 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470389 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470477 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470694 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470789 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.470994 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471091 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471301 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471396 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471604 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471691 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.471904 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472000 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472200 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472288 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472505 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472641 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472838 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.472927 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473142 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473231 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473457 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473559 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473772 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.473862 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474071 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474160 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474368 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474465 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474686 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.474774 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.475516 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.475621 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.475819 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.475916 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476119 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476215 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476416 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476504 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476775 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.476867 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477083 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477171 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477382 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477470 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477692 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.477781 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478007 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478096 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478312 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478402 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478617 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478707 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.478926 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479017 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479230 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479318 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479545 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479635 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479852 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.479951 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.480157 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.480255 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.480461 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.480549 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.480787 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481091 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481188 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481395 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481493 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481712 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.481800 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482105 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482321 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482411 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482624 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482713 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.482923 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483010 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483225 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483315 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483538 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483634 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.483916 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484102 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484231 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484430 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484542 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.484867 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485081 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485169 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485395 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485485 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485751 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.485888 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486067 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486165 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486390 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486494 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486710 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.486798 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487021 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487119 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487325 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487414 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487626 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487715 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.487927 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488016 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488233 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488324 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488533 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488669 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488861 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.488961 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489162 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489264 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489467 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489564 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489764 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.489853 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.490063 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.490153 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.490360 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.490448 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491194 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491547 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491636 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491892 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.491980 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492203 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492299 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492503 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492655 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492845 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.492943 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493149 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493246 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493448 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493543 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493746 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.493842 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494045 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494142 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494369 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494456 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494668 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494763 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.494991 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495088 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495300 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495392 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495616 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495705 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.495928 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496017 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496228 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496317 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496537 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496652 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496862 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.496951 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497162 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497250 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497488 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497577 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497793 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.497889 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498097 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498186 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498494 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498700 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.498788 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499008 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499096 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499316 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499413 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499620 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499707 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.499914 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500003 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500219 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500364 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500626 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500850 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.500940 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501153 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501252 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501451 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501540 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501748 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.501850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502061 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502177 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502350 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502444 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502645 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502733 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.502949 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503047 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503245 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503334 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503559 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503661 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503853 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.503944 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504150 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504259 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504447 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504544 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504786 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.504888 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505086 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505184 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505384 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505491 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505704 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.505793 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506008 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506098 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506329 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506434 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506627 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506716 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.506930 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507020 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507227 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507324 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507525 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507614 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507829 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.507958 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508144 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508453 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508543 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508778 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.508878 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509084 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509182 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509382 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509471 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509681 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509770 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.509981 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510079 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510283 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510373 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510579 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510668 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510876 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.510967 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511175 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511287 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511471 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511597 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511769 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.511919 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512087 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512256 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512392 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512625 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512719 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.512916 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513233 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513322 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513540 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513638 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513861 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.513949 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514174 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514262 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514519 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514618 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514829 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.514920 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515143 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515240 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515449 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515545 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515755 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.515845 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516062 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516205 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516361 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516452 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516699 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.516792 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517008 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517115 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517315 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517404 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517614 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517710 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.517912 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518016 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518309 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518528 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518615 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518840 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.518936 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519153 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519242 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519469 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519556 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519790 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.519889 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520090 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520179 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520394 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520482 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520720 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.520813 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521026 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521114 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521330 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521419 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521634 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521734 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.521959 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522060 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522266 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522363 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522572 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522670 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522880 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.522969 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523186 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523282 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523486 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523574 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523791 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.523880 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524094 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524394 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524536 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524735 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.524873 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525043 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525187 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525344 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525542 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525678 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525862 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.525979 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526179 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526327 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526498 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526588 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526806 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.526977 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527227 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527326 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527539 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527627 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527852 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.527949 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528152 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528249 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528458 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528547 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528788 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.528888 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529095 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529184 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529521 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529713 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.529813 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530020 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530108 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530325 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530412 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530648 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530751 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.530955 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531052 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531251 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531340 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531557 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531682 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531877 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.531994 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.532177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.532300 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.532474 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.532794 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.532898 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533113 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533205 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533413 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533511 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533730 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.533821 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534052 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534146 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534382 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534480 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534691 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.534779 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535012 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535100 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535324 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535413 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535651 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.535978 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536078 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536288 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536415 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536628 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536723 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.536941 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.537042 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.537267 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.537356 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538115 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538214 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538431 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538529 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538754 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.538843 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539063 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539175 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539375 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539504 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539674 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539818 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.539992 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540143 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540312 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540471 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540644 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540797 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.540965 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541098 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541374 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541470 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541694 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541796 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.541998 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542086 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542312 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542400 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542618 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542719 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.542953 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543041 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543252 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543339 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543559 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543662 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543861 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.543949 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544162 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544252 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544480 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544617 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544804 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.544904 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545110 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545198 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545415 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545512 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545718 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.545806 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546113 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546315 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546413 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546631 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546727 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.546930 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547019 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547249 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547347 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547550 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547646 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547857 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.547960 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548170 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548265 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548472 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548560 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548814 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.548920 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.549381 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.549476 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.549682 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.549795 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.549982 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550146 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550281 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550455 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550788 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.550918 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551113 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551233 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551436 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551562 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551765 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.551886 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552075 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552192 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552383 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552521 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552724 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.552871 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.553034 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.553744 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.553883 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554047 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554195 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554371 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554535 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554747 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.554839 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555014 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555138 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555319 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555448 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555621 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555873 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.555952 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556191 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556270 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556503 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556600 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556828 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.556920 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557129 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557208 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557430 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557506 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557734 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.557810 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558384 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558455 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558522 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558597 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558673 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558749 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.558929 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559009 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559231 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559331 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559537 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559643 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559871 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.559962 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.560171 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.560268 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.560507 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.560648 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.560857 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561000 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561179 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561278 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561499 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561589 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561805 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.561893 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562123 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562210 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562436 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562525 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562746 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.562834 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563057 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563370 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563467 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563682 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563772 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.563992 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564223 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564313 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564557 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564676 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564900 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.564989 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.565215 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.565305 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.565534 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.565630 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.565852 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566154 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566258 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566469 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566557 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566779 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.566867 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567092 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567181 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567400 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567488 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567710 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.567799 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568020 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568150 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568327 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568428 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568661 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.568775 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569001 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569092 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569308 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569411 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569631 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569730 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.569950 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570039 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570272 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570367 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570605 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570713 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.570913 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571002 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571223 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571312 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571563 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571653 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.571878 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572039 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572191 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572308 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572507 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572677 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572845 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.572963 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573156 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573283 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573470 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573587 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573777 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.573901 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574085 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574215 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574391 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574509 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574700 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.574818 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575006 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575133 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575314 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575431 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575622 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575741 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.575930 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576057 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576239 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576365 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576558 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576848 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.576955 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577196 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577286 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577505 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577594 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577817 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.577915 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578128 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578255 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578484 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578645 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578805 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.578963 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579137 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579293 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579450 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579615 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579779 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.579937 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580064 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580254 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580380 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580567 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580723 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.580915 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581031 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581219 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581351 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581522 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581663 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581829 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.581989 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.582134 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.582302 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.582434 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.582752 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.582841 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583062 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583204 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583390 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583529 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583708 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.583860 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.584014 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.584190 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.584536 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.584659 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.584928 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585019 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585246 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585342 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585572 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585671 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585897 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.585998 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586211 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586300 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586615 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586837 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.586926 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587144 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587232 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587443 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587542 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587757 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.587853 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588063 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588152 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588361 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588490 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588684 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.588789 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589000 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589089 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589308 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589399 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589607 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589706 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.589912 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590001 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590210 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590300 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590521 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590610 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590821 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.590924 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591121 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591210 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591421 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591515 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591728 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.591827 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592028 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592118 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592327 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592416 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592650 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592758 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.592953 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593051 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593258 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593346 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593556 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593654 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593861 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.593958 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594160 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594301 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594465 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594613 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594763 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.594921 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595068 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595243 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595413 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595566 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595731 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.595892 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596031 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596206 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596330 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596520 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596659 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.596916 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597006 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597344 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597566 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597790 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.597880 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.598134 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.598232 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.598512 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.598625 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.598792 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599022 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599119 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599352 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599444 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599670 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.599760 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.600603 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.600738 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.600898 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.600990 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601202 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601304 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601504 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601597 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601807 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.601910 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602127 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602270 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602438 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602538 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602745 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.602834 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603052 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603141 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603361 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603461 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603668 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603757 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.603975 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604065 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604283 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604409 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604633 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604728 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.604920 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605012 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605229 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605329 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605536 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605626 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605843 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.605939 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606151 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606464 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606553 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606800 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.606889 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607117 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607209 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607431 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607522 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607744 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.607844 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608057 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608147 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608364 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608460 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608710 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.608834 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609018 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609108 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609325 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609413 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609634 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609801 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.609963 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610054 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610272 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610362 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610575 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610665 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.610969 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611057 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611290 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611386 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611607 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611698 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.611952 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612051 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612258 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612348 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612636 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612743 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.612919 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613007 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613226 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613329 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613545 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613634 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613853 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.613943 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614178 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614278 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614493 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614582 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614804 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.614892 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.615118 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.615228 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.615519 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.616287 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.616394 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.616605 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.616715 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.616920 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617010 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617234 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617329 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617539 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617630 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617843 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.617953 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618138 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618228 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618443 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618533 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618817 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.618918 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619046 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619346 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619437 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619648 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619738 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.619952 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620040 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620249 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620339 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620550 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620711 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620872 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.620975 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621171 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621260 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621468 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621557 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621770 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.621876 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622074 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622163 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622404 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622546 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622676 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622777 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.622975 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623098 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623275 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623419 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623573 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623751 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.623900 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624067 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624230 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624393 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624542 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624732 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.624881 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625061 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625189 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625388 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625510 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625712 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.625801 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626026 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626129 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626361 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626461 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626675 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626764 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.626988 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627077 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627302 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627392 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627614 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627704 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.627921 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628016 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628230 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628329 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628678 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.628908 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629059 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629216 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629322 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629539 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629646 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629862 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.629951 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630165 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630256 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630487 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630577 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630798 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.630901 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631228 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631450 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631554 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631758 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.631857 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632075 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632163 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632380 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632468 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632716 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.632824 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633038 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633132 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633360 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633449 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633694 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.633785 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634029 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634127 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634343 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634432 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634668 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634766 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.634996 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635085 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635306 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635401 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635634 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635726 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.635960 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636049 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636304 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636403 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636643 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636736 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.636963 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.637052 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.637271 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.637368 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.637518 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:11:46.637608 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.637902 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.638203 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:11:46.638448 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:11:46.697727 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Registered counter for database nova_api May 26 21:11:46.698668 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO dbcounter [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Registered counter for database nova_api May 26 21:11:46.718761 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-864e079a-218d-4b58-864e-3a71be305499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.722325 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_db.sqlalchemy.engines [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.726036 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.729497 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writer thread running {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.784634 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.context [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97faeabc-1cd1-4d3b-8b75-7848ba9e27ca(cell1) {{(pid=103892) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:11:46.786462 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.context [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97faeabc-1cd1-4d3b-8b75-7848ba9e27ca(cell1) {{(pid=103893) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:11:46.789500 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:11:46.791105 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:11:46.791246 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_concurrency.lockutils [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:11:46.791914 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:11:46.792716 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_concurrency.lockutils [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:11:46.793515 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_concurrency.lockutils [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:11:46.793916 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:11:46.795619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_concurrency.lockutils [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:11:46.795955 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Registered counter for database nova_cell0 May 26 21:11:46.797601 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO dbcounter [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Registered counter for database nova_cell0 May 26 21:11:46.800237 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Registered counter for database nova_cell1 May 26 21:11:46.801774 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO dbcounter [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Registered counter for database nova_cell1 May 26 21:11:46.807657 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-864e079a-218d-4b58-864e-3a71be305499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.809034 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-864e079a-218d-4b58-864e-3a71be305499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.811861 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_db.sqlalchemy.engines [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.812864 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_db.sqlalchemy.engines [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.815068 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.820264 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.820780 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writer thread running {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.821122 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writer thread running {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.964684 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO dbcounter [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Registered counter for database nova_cell0 May 26 21:11:46.971615 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO dbcounter [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Registered counter for database nova_cell0 May 26 21:11:46.973290 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_db.sqlalchemy.engines [None req-864e079a-218d-4b58-864e-3a71be305499 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.978250 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writer thread running {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:46.980951 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG oslo_db.sqlalchemy.engines [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:11:46.985338 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writer thread running {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:11:47.385178 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-864e079a-218d-4b58-864e-3a71be305499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:11:47.392565 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:11:47.442136 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: WARNING keystonemiddleware.auth_token [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:11:47.450403 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: WARNING keystonemiddleware.auth_token [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:11:47.736285 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-864e079a-218d-4b58-864e-3a71be305499 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:11:47.742858 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: WARNING keystonemiddleware.auth_token [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:11:47.748175 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633641b49c0 pid: 103892 (default app) May 26 21:11:47.750396 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:11:47.751578 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-864e079a-218d-4b58-864e-3a71be305499 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 May 26 21:11:47.751990 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Thu May 26 21:11:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:11:47.790968 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: WARNING keystonemiddleware.auth_token [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:11:47.796956 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: WARNING keystonemiddleware.auth_token [None req-a604264e-d755-4060-aea0-dfbfb6989a6f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:11:47.802469 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5633641b49c0 pid: 103893 (default app) May 26 21:13:09.322013 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:09.323022 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-864e079a-218d-4b58-864e-3a71be305499 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 26 21:13:09.323434 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:09.335405 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_api:SELECT=3 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.336265 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_cell0:SELECT=3 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.337115 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_cell1:SELECT=3 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.338415 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:09.782344 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-97d8dd2b-fa74-4d06-9018-a2f4f5790568 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:09.813310 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-97d8dd2b-fa74-4d06-9018-a2f4f5790568 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483117 May 26 21:13:09.814043 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1291 bytes} [Thu May 26 21:13:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:12.102610 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-864e079a-218d-4b58-864e-3a71be305499 None None] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:12.103628 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-864e079a-218d-4b58-864e-3a71be305499 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 26 21:13:12.109645 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:12 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:12.167677 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-07ce35ae-0ef1-4dd5-9d31-759cf09655ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "swap": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:12.187785 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:13:12.187785 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: warnings.warn(msg) May 26 21:13:12.325643 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-07ce35ae-0ef1-4dd5-9d31-759cf09655ce admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.215016 May 26 21:13:12.326430 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:12.339936 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:12.340854 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell1:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:12.341906 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell0:SELECT=3 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:12.342988 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:13:12.547066 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-376c90b2-96a2-4b8f-b4bd-98f9174270c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:12.549508 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:13:12.549508 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:13:12.717031 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-376c90b2-96a2-4b8f-b4bd-98f9174270c4 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.382182 May 26 21:13:12.721457 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1335 bytes} [Thu May 26 21:13:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:14.967755 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-07ce35ae-0ef1-4dd5-9d31-759cf09655ce admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:14.972407 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-07ce35ae-0ef1-4dd5-9d31-759cf09655ce admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 26 21:13:14.972407 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:15.076312 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-22dd9809-178b-408c-b791-2f71443e2f63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "name": "ds512M"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:15.094578 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:13:15.094578 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:13:15.249635 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-22dd9809-178b-408c-b791-2f71443e2f63 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.274423 May 26 21:13:15.250295 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:15.264855 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-125ed64a-8ac5-410b-b579-8685d1512b2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:15.266444 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:13:15.266444 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: warnings.warn(msg) May 26 21:13:15.468934 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-125ed64a-8ac5-410b-b579-8685d1512b2c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.208767 May 26 21:13:15.469775 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1335 bytes} [Thu May 26 21:13:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:17.727897 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-22dd9809-178b-408c-b791-2f71443e2f63 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:17.728991 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-22dd9809-178b-408c-b791-2f71443e2f63 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 26 21:13:17.729655 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:17.789886 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-ffe3df5d-132e-4739-9da9-79c805be12d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "name": "ds1G", "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:17.881508 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-ffe3df5d-132e-4739-9da9-79c805be12d8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.145699 May 26 21:13:17.882001 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:13:17.894119 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-e17fed21-6bd0-4a62-a761-31560a3a8374 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:17.998782 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-e17fed21-6bd0-4a62-a761-31560a3a8374 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108306 May 26 21:13:17.999368 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1335 bytes} [Thu May 26 21:13:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:20.277257 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-ffe3df5d-132e-4739-9da9-79c805be12d8 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:20.278267 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-ffe3df5d-132e-4739-9da9-79c805be12d8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 26 21:13:20.278667 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:20.339033 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ed91e002-9a07-4e2a-b94e-988ef3b4c5a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:20.446788 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-ed91e002-9a07-4e2a-b94e-988ef3b4c5a1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157078 May 26 21:13:20.446788 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:13:20.454520 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-7333d685-7976-42b9-ba74-195c6b6e6383 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:20.580387 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-7333d685-7976-42b9-ba74-195c6b6e6383 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129457 May 26 21:13:20.581076 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1335 bytes} [Thu May 26 21:13:20 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:22.831786 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ed91e002-9a07-4e2a-b94e-988ef3b4c5a1 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:22.832744 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-ed91e002-9a07-4e2a-b94e-988ef3b4c5a1 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001988 May 26 21:13:22.833141 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:22.896293 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "id": "d4", "vcpus": 4, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:22.983867 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144407 May 26 21:13:22.984558 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:13:22.996664 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-14b829bd-3928-4352-bbe5-5e616df8ab27 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:23.073594 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-14b829bd-3928-4352-bbe5-5e616df8ab27 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080557 May 26 21:13:23.074176 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1335 bytes} [Thu May 26 21:13:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:25.331931 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:25.332980 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 26 21:13:25.333370 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:25.396046 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-a33efb6e-b14a-49f3-9196-bb04f9bc71c0 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:25.420625 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-a33efb6e-b14a-49f3-9196-bb04f9bc71c0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081095 May 26 21:13:25.421969 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1291 bytes} [Thu May 26 21:13:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:13:27.724130 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:27.725229 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-85899b96-aef6-43fb-991a-55fae56d3aee admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 May 26 21:13:27.725643 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:27.788152 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-64e11639-0a22-497c-99f7-e6c821339b04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:27.870756 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-64e11639-0a22-497c-99f7-e6c821339b04 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.138655 May 26 21:13:27.871338 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:13:27.884531 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-319f9a8d-1916-464c-839b-9cda685d89ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:27.993711 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-319f9a8d-1916-464c-839b-9cda685d89ad admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113117 May 26 21:13:27.994522 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1332 bytes} [Thu May 26 21:13:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:30.309102 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-64e11639-0a22-497c-99f7-e6c821339b04 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:30.310156 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-64e11639-0a22-497c-99f7-e6c821339b04 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 May 26 21:13:30.310571 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:30.380904 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-ededebb4-3101-454d-b454-99987d9958c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "2", "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:30.463881 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-ededebb4-3101-454d-b454-99987d9958c6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146129 May 26 21:13:30.464481 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:30.479343 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-270c98e1-7562-4ddc-a125-47b1709c8b51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:30.564795 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-270c98e1-7562-4ddc-a125-47b1709c8b51 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089225 May 26 21:13:30.565427 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1332 bytes} [Thu May 26 21:13:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:32.864513 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-ededebb4-3101-454d-b454-99987d9958c6 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:32.865563 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-ededebb4-3101-454d-b454-99987d9958c6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 26 21:13:32.865963 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:32.924034 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-9110fe9b-c2c2-4af6-a159-ae1b5de9fcd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "vcpus": 2, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:33.000428 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-9110fe9b-c2c2-4af6-a159-ae1b5de9fcd9 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.128463 May 26 21:13:33.001006 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:33.012712 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-8fc69e5c-bf50-4073-a78e-952800024cce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:33.112984 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-8fc69e5c-bf50-4073-a78e-952800024cce admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103137 May 26 21:13:33.113498 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1332 bytes} [Thu May 26 21:13:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:35.403357 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-9110fe9b-c2c2-4af6-a159-ae1b5de9fcd9 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:35.404025 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-9110fe9b-c2c2-4af6-a159-ae1b5de9fcd9 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 26 21:13:35.404454 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:35.462422 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-e7baacd7-6811-41bc-a687-18db72d6ba84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "ram": 8192, "vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:35.559836 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-e7baacd7-6811-41bc-a687-18db72d6ba84 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.148765 May 26 21:13:35.560412 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:35.572270 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ebb59fc7-314b-4c57-a09c-0039de0cc211 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:35.672925 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-ebb59fc7-314b-4c57-a09c-0039de0cc211 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104279 May 26 21:13:35.673515 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1332 bytes} [Thu May 26 21:13:35 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:13:37.983392 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-e7baacd7-6811-41bc-a687-18db72d6ba84 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:13:37.985033 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-e7baacd7-6811-41bc-a687-18db72d6ba84 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 May 26 21:13:37.985605 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:13:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:13:38.051750 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "ram": 16384, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 8}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:38.126246 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.134395 May 26 21:13:38.126770 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1282 bytes} [Thu May 26 21:13:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:13:38.139687 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-97c68e37-a72e-4c2e-a487-30d5d87f2f67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:13:38.244213 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-97c68e37-a72e-4c2e-a487-30d5d87f2f67 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108583 May 26 21:13:38.244838 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1332 bytes} [Thu May 26 21:13:38 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:14:03.012053 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:03.013174 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 May 26 21:14:03.013579 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:14:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:03.024986 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:03.073634 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-3bebceeb-a63f-4a5b-986a-4636a5e33b0d admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:03.090974 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-3bebceeb-a63f-4a5b-986a-4636a5e33b0d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070724 May 26 21:14:03.091518 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1291 bytes} [Thu May 26 21:14:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:04.076547 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:04.077575 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-5cd0a4a1-625f-403c-b400-2807248bce44 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 May 26 21:14:04.077976 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:04.274592 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-67d9e91e-5386-4d10-9e75-ec0c6e84a669 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:04.280153 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.wsgi [None req-67d9e91e-5386-4d10-9e75-ec0c6e84a669 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-67d9e91e-5386-4d10-9e75-ec0c6e84a669 admin admin] Request method failure captured: May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept: application/json May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept-Encoding: gzip, deflate May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Connection: keep-alive May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Content-Length: 0 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Host: 10.222.0.66 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-Api-Version: compute 2.90 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-System-Scope: None May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: User-Agent: python-novaclient May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Auth-Token: gAAAAABij-2c-UpiEVFZpjSXwvPUzWRKws-_F7QT60CY-TeyEauPtUdLz6XuiXNhPGKeN4wXXIJmAdohBSCzCZYqqSjyxa3BUEBKe8E1RjIt4L8L5n7iCMoJIMlVOcFFkcVlJcZBNSuiagofuzmUZ3gTEq357MSXTsNFY-_kt58IBVIjc5_-yIw May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Id: None May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Name: None May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Identity-Status: Confirmed May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Is-Admin-Project: True May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Id: default May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Name: Default May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Name: admin May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Role: reader,admin,member May 26 21:14:04.283396 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Roles: reader,admin,member May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant: admin May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Name: admin May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User: admin May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Id: default May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Name: Default May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Name: admin May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: method: > May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: exception: Flavor 42 could not be found. May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: action_args: {'id': '42'} May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:04.285662 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:04.286570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:04.287740 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-67d9e91e-5386-4d10-9e75-ec0c6e84a669 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:04.288806 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-67d9e91e-5386-4d10-9e75-ec0c6e84a669 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061270 May 26 21:14:04.288806 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Thu May 26 21:14:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:04.297038 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-8eda9bc7-aae1-4d0a-a2e9-7a2c079cd4e8 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:04.300014 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:14:04.318630 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-8eda9bc7-aae1-4d0a-a2e9-7a2c079cd4e8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025467 May 26 21:14:04.319164 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:04.328754 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-19806ad2-32f8-4d3f-a161-1b4ae7efb919 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:04.351268 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-19806ad2-32f8-4d3f-a161-1b4ae7efb919 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026016 May 26 21:14:04.351824 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:04.361687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-cc942287-0c5f-491b-830a-bd5134c9c744 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:04.367930 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-cc942287-0c5f-491b-830a-bd5134c9c744 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-cc942287-0c5f-491b-830a-bd5134c9c744 admin admin] Request method failure captured: May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept: application/json May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Connection: keep-alive May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Content-Length: 0 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Host: 10.222.0.66 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABij-2c-UpiEVFZpjSXwvPUzWRKws-_F7QT60CY-TeyEauPtUdLz6XuiXNhPGKeN4wXXIJmAdohBSCzCZYqqSjyxa3BUEBKe8E1RjIt4L8L5n7iCMoJIMlVOcFFkcVlJcZBNSuiagofuzmUZ3gTEq357MSXTsNFY-_kt58IBVIjc5_-yIw May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Id: None May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Name: None May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Name: admin May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Role: reader,admin,member May 26 21:14:04.371220 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Roles: reader,admin,member May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant: admin May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User: admin May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Name: admin May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: method: > May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: exception: Flavor 42 could not be found. May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: action_args: {'id': '42'} May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:04.376687 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:04.377846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:04.379155 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-cc942287-0c5f-491b-830a-bd5134c9c744 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:04.380367 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-cc942287-0c5f-491b-830a-bd5134c9c744 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014826 May 26 21:14:04.380367 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Thu May 26 21:14:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:05.242530 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-19806ad2-32f8-4d3f-a161-1b4ae7efb919 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:05.243570 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-19806ad2-32f8-4d3f-a161-1b4ae7efb919 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 May 26 21:14:05.244022 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:05.433893 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ca72bea0-3d7b-4e7b-a5a1-f14200d05e19 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:05.439142 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-ca72bea0-3d7b-4e7b-a5a1-f14200d05e19 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ca72bea0-3d7b-4e7b-a5a1-f14200d05e19 admin admin] Request method failure captured: May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept: application/json May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Connection: keep-alive May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Content-Length: 0 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Host: 10.222.0.66 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABij-2dHmR-DjDiVCXcwxzo-E1SWTxSFb1ksSluTiQMMVkkqHxPg3FafAmjAh5RQpEVPPBegBrF0wawPeHVAJBfZ-ZDPLKlAxH_9uDJS5JS4liS1askTYxkGhv-IzLMNKfq3OclVaNsHT3Qc_2oY0zlnAt6BIP86PDz_lBZwNSKC_VNyXM May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Id: None May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Name: None May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Name: admin May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Role: reader,admin,member May 26 21:14:05.441241 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Roles: reader,admin,member May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant: admin May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User: admin May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Name: admin May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: method: > May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: exception: Flavor 84 could not be found. May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: action_args: {'id': '84'} May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:05.442850 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:05.443836 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:05.445292 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-ca72bea0-3d7b-4e7b-a5a1-f14200d05e19 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:05.446668 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-ca72bea0-3d7b-4e7b-a5a1-f14200d05e19 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061225 May 26 21:14:05.446668 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Thu May 26 21:14:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:05.452441 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-ef52b27f-fc6c-4dc7-874e-687bd74282ac admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:05.468663 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-ef52b27f-fc6c-4dc7-874e-687bd74282ac admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019839 May 26 21:14:05.469254 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:05.481811 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b81d5394-0f58-4598-ae85-ad2e15f0dc85 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:05.495862 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b81d5394-0f58-4598-ae85-ad2e15f0dc85 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017979 May 26 21:14:05.496387 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:05.506096 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-78f358ce-fb09-4f99-a40b-00e1ec76f59a admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:05.511648 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.wsgi [None req-78f358ce-fb09-4f99-a40b-00e1ec76f59a admin admin] HTTP exception thrown: Flavor 84 could not be found. May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-78f358ce-fb09-4f99-a40b-00e1ec76f59a admin admin] Request method failure captured: May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept: application/json May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept-Encoding: gzip, deflate May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Connection: keep-alive May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Content-Length: 0 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Host: 10.222.0.66 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-Api-Version: compute 2.90 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-System-Scope: None May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: User-Agent: python-novaclient May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Auth-Token: gAAAAABij-2dHmR-DjDiVCXcwxzo-E1SWTxSFb1ksSluTiQMMVkkqHxPg3FafAmjAh5RQpEVPPBegBrF0wawPeHVAJBfZ-ZDPLKlAxH_9uDJS5JS4liS1askTYxkGhv-IzLMNKfq3OclVaNsHT3Qc_2oY0zlnAt6BIP86PDz_lBZwNSKC_VNyXM May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Id: None May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Name: None May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Identity-Status: Confirmed May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Is-Admin-Project: True May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Id: default May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Name: Default May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Name: admin May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Role: reader,admin,member May 26 21:14:05.514177 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Roles: reader,admin,member May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant: admin May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Name: admin May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User: admin May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Id: default May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Name: Default May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Name: admin May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: method: > May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: exception: Flavor 84 could not be found. May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: action_args: {'id': '84'} May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:05.515701 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:05.516619 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:05.518222 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-78f358ce-fb09-4f99-a40b-00e1ec76f59a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:05.520075 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-78f358ce-fb09-4f99-a40b-00e1ec76f59a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013321 May 26 21:14:05.520075 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Thu May 26 21:14:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:06.381406 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b81d5394-0f58-4598-ae85-ad2e15f0dc85 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:06.382411 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b81d5394-0f58-4598-ae85-ad2e15f0dc85 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 26 21:14:06.382806 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:06.571320 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-edc30e3c-6909-46e2-9923-8a7716dae00d admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:06.576863 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.wsgi [None req-edc30e3c-6909-46e2-9923-8a7716dae00d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-edc30e3c-6909-46e2-9923-8a7716dae00d admin admin] Request method failure captured: May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept: application/json May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Accept-Encoding: gzip, deflate May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Connection: keep-alive May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Content-Length: 0 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Host: 10.222.0.66 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-Api-Version: compute 2.90 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Openstack-System-Scope: None May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: User-Agent: python-novaclient May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Auth-Token: gAAAAABij-2ezFaOfspEN4m2nPXll9cW87qLzQnqxbW6hClokfXwxIqX6O2AntHXJZtpwZi1_Ptwc8bpxGuUnEfPsZjtg0SLjAdTHVLeb47IklvXmCP9WVz8HBEhQOgFoXF7De16lbQcsg5eZaNSqUcJzrnzuLtN9hZFbj3uyXLUWWSZBNyWxtY May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Id: None May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Domain-Name: None May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Identity-Status: Confirmed May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Is-Admin-Project: True May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Id: default May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Domain-Name: Default May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Project-Name: admin May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Role: reader,admin,member May 26 21:14:06.578517 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Roles: reader,admin,member May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant: admin May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-Tenant-Name: admin May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User: admin May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Id: default May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Domain-Name: Default May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: X-User-Name: admin May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: method: > May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: exception: Flavor 451 could not be found. May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: action_args: {'id': '451'} May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:06.580114 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:06.581766 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: ERROR nova.api.openstack.wsgi May 26 21:14:06.583148 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-edc30e3c-6909-46e2-9923-8a7716dae00d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:06.584444 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-edc30e3c-6909-46e2-9923-8a7716dae00d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059684 May 26 21:14:06.584444 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:14:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:06.590156 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-036a1d19-f698-4627-adc3-1ab4c091f45a admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:06.604643 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-036a1d19-f698-4627-adc3-1ab4c091f45a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017940 May 26 21:14:06.605115 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:06.615189 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:06.628334 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017235 May 26 21:14:06.628961 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Thu May 26 21:14:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:14:06.638144 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e793815-e2f8-4412-b128-b2b8014aad9a admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:06.643496 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.wsgi [None req-0e793815-e2f8-4412-b128-b2b8014aad9a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e793815-e2f8-4412-b128-b2b8014aad9a admin admin] Request method failure captured: May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept: application/json May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Accept-Encoding: gzip, deflate May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Connection: keep-alive May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Content-Length: 0 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Host: 10.222.0.66 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-Api-Version: compute 2.90 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Openstack-System-Scope: None May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: User-Agent: python-novaclient May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Auth-Token: gAAAAABij-2ezFaOfspEN4m2nPXll9cW87qLzQnqxbW6hClokfXwxIqX6O2AntHXJZtpwZi1_Ptwc8bpxGuUnEfPsZjtg0SLjAdTHVLeb47IklvXmCP9WVz8HBEhQOgFoXF7De16lbQcsg5eZaNSqUcJzrnzuLtN9hZFbj3uyXLUWWSZBNyWxtY May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Id: None May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Domain-Name: None May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Identity-Status: Confirmed May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Is-Admin-Project: True May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Openstack-Nova-Api-Version: 2.90 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Id: default May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Domain-Name: Default May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Project-Name: admin May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Role: reader,admin,member May 26 21:14:06.645568 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Roles: reader,admin,member May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7b6a47aff4f04a489b501a19f68711d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant: admin May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Id: 7b6a47aff4f04a489b501a19f68711d3 May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-Tenant-Name: admin May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User: admin May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Id: default May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Domain-Name: Default May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Id: 360bd68e46a04911b5f7e4be275448d0 May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: X-User-Name: admin May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: method: > May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: exception: Flavor 451 could not be found. May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: action_args: {'id': '451'} May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:14:06.647136 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:06.647974 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: ERROR nova.api.openstack.wsgi May 26 21:14:06.649242 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-0e793815-e2f8-4412-b128-b2b8014aad9a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:14:06.650505 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-0e793815-e2f8-4412-b128-b2b8014aad9a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012254 May 26 21:14:06.650505 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:14:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 26 21:14:07.516405 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:07.517487 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 26 21:14:07.517884 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:07.707126 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-28bb8ebe-3269-4181-91e3-7ba1216cf7be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:14:07.798058 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-28bb8ebe-3269-4181-91e3-7ba1216cf7be admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.143545 May 26 21:14:07.798607 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Thu May 26 21:14:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:14:08.656744 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:08.657805 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 26 21:14:08.658215 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:08.848942 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-c673de36-030c-4e93-9c7f-0f68ba92ae5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:14:08.969866 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-c673de36-030c-4e93-9c7f-0f68ba92ae5d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.173077 May 26 21:14:08.970424 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Thu May 26 21:14:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:14:09.957560 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:09.958556 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 26 21:14:09.958976 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:10.146045 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-7509ca33-9669-4ad1-bd67-d5994ed36109 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:14:10.266451 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-7509ca33-9669-4ad1-bd67-d5994ed36109 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.172416 May 26 21:14:10.266992 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Thu May 26 21:14:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:14:11.132255 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:11.133290 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001536 May 26 21:14:11.133690 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:11.322424 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-b553f906-c528-461b-afd4-a1aae277c04f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:14:11.393084 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-b553f906-c528-461b-afd4-a1aae277c04f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.122349 May 26 21:14:11.393609 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Thu May 26 21:14:11 2022] POST /compute/v2.1/flavors => generated 409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:14:12.258511 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:12.259520 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 26 21:14:12.259913 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:14:12.449172 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-bc5a4814-7293-44ad-a325-5926addcbb25 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:14:12.468870 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-bc5a4814-7293-44ad-a325-5926addcbb25 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073160 May 26 21:14:12.469411 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Thu May 26 21:14:12 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:15:14.558209 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.559234 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-37450d25-ab1e-4807-911b-3a4e4a3b7454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 26 21:15:14.559584 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 930 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:15:14.567048 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:14.621083 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-f926d708-61c9-4586-a925-a95480f60019 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.639842 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-f926d708-61c9-4586-a925-a95480f60019 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074172 May 26 21:15:14.640376 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1291 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:15:14.661473 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG dbcounter [-] [103893] Writing DB stats nova_api:SELECT=14 {{(pid=103893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:15:14.665306 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-c3915457-7b45-4d5f-9f49-67271c0f6d64 admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.673859 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-c3915457-7b45-4d5f-9f49-67271c0f6d64 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013725 May 26 21:15:14.674405 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1282 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:15:14.689388 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-c415eb06-c247-426f-965a-95afac890bfb admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.697386 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-c415eb06-c247-426f-965a-95afac890bfb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012088 May 26 21:15:14.697907 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1285 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:15:14.709989 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.717912 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011561 May 26 21:15:14.718436 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1285 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:15:14.731531 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-5b0b4135-cf4d-489e-a36b-7cbab3b0b315 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:15:14.739188 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-5b0b4135-cf4d-489e-a36b-7cbab3b0b315 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011329 May 26 21:15:14.739693 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1282 bytes} [Thu May 26 21:15:14 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:18:55.917017 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:55.918025 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 May 26 21:18:55.918449 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:18:56.076846 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=6 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:18:56.212027 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:56.213320 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:56.213320 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:18:56.214672 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:18:56.215125 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:18:56.215918 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:18:56.216344 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:18:56.255541 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-74801a2e-f3f3-4c31-a2ca-821d499cc968 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.180084 May 26 21:18:56.256341 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:18:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:18:57.160624 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:57.162111 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002653 May 26 21:18:57.162633 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:18:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:18:57.362224 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:18:57.363497 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:18:57.363497 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:18:57.364772 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:18:57.365224 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:18:57.366018 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:18:57.366448 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:18:57.387046 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-878d455a-5620-46a2-86de-ac479d40d404 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082988 May 26 21:18:57.391469 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:18:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:19:08.743479 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:08.745134 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 May 26 21:19:08.745540 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:08.892213 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell0:SELECT=4 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:08.892856 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_cell1:SELECT=4 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:08.893461 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG dbcounter [-] [103892] Writing DB stats nova_api:SELECT=8 {{(pid=103892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:19:08.945051 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:08.946261 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:19:08.946261 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:19:08.948145 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:19:08.948703 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:19:08.949504 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:19:08.949941 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:19:08.976609 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-f8636db9-1dc4-44f9-815d-27ba722810fd admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089184 May 26 21:19:08.977181 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:19:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:19:09.866338 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: DEBUG nova.api.openstack.wsgi [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] Calling method '>' {{(pid=103893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:09.867381 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: INFO nova.api.openstack.requestlog [None req-79aeca6a-8891-4e84-bfb2-1bece39ce0fc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 26 21:19:09.867784 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: [pid: 103893|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Thu May 26 21:19:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:19:10.089073 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG nova.api.openstack.wsgi [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] Calling method '>' {{(pid=103892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:19:10.090290 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 21:19:10.090290 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: warnings.warn(msg) May 26 21:19:10.091527 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:19:10.091971 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:19:10.092799 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:19:10.093229 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: DEBUG oslo_concurrency.lockutils [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:19:10.115250 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: INFO nova.api.openstack.requestlog [None req-75e09b63-a82c-4ef1-97a0-9bc9da887eef admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.106266 May 26 21:19:10.115837 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: [pid: 103892|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Thu May 26 21:19:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:20:07.311083 dv-cinder-828807-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 26 21:20:07.312025 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: Thu May 26 21:20:07 2022 - graceful shutdown triggered... May 26 21:20:07.312491 dv-cinder-828807-3-iscsi devstack@n-api.service[103893]: Gracefully killing worker 2 (pid: 103893)... May 26 21:20:07.312915 dv-cinder-828807-3-iscsi devstack@n-api.service[103892]: Gracefully killing worker 1 (pid: 103892)... May 26 21:20:08.311935 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: worker 1 buried after 1 seconds May 26 21:20:08.311935 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: worker 2 buried after 1 seconds May 26 21:20:08.311935 dv-cinder-828807-3-iscsi devstack@n-api.service[103891]: goodbye to uWSGI. May 26 21:20:08.313476 dv-cinder-828807-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 26 21:20:08.314090 dv-cinder-828807-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 26 21:20:08.316957 dv-cinder-828807-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 26 21:20:08.334644 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 21:20:08 2022] *** May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: nodename: dv-cinder-828807-3-iscsi May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: machine: x86_64 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: clock source: unix May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: pcre jit disabled May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: detected number of CPU cores: 4 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: current working directory: / May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: detected binary path: /usr/bin/uwsgi-core May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: your processes number limit is 47680 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: your memory page size is 4096 bytes May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: detected max file descriptor number: 2048 May 26 21:20:08.353436 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: lock engine: pthread robust mutexes May 26 21:20:08.354557 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: thunder lock: enabled May 26 21:20:08.354557 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 26 21:20:08.354557 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 21:20:08.401245 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: Python main interpreter initialized at 0x55692633e9c0 May 26 21:20:08.401245 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: python threads support enabled May 26 21:20:08.401245 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: your server socket listen backlog is limited to 100 connections May 26 21:20:08.401245 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: your mercy for graceful operations on workers is 90 seconds May 26 21:20:08.401705 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: mapped 403077 bytes (393 KB) for 2 cores May 26 21:20:08.401705 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: *** Operational MODE: preforking *** May 26 21:20:08.402000 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: *** uWSGI is running in multiple interpreter mode *** May 26 21:20:08.402000 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: spawned uWSGI master process (pid: 118336) May 26 21:20:08.404625 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: spawned uWSGI worker 1 (pid: 118354, cores: 1) May 26 21:20:08.402210 dv-cinder-828807-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 26 21:20:08.408993 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: spawned uWSGI worker 2 (pid: 118355, cores: 1) May 26 21:20:08.409592 dv-cinder-828807-3-iscsi devstack@n-api.service[118336]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 21:20:09.622030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:20:09.639240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 26 21:20:10.419683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:20:10.419683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: from cryptography.utils import int_from_bytes May 26 21:20:10.419998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:20:10.419998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: from cryptography.utils import int_from_bytes May 26 21:20:10.436456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:20:10.436456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: from cryptography.utils import int_from_bytes May 26 21:20:10.436818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 21:20:10.436818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: from cryptography.utils import int_from_bytes May 26 21:20:12.860369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:20:12.860983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:20:12.861291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:20:12.861539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:20:12.861799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:20:12.862187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.862531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.862843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.863166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.863505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.863823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.864151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.864475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.864834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.865099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.865416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.865747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-3-iscsi {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.866074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.866390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.866877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.867390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.867871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.868387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.868739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.869249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.870599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.870599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.870599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.871054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.871282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.871583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.871900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.872210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.872538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.872907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.873303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-3-iscsi {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.873626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.873941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.874258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.874683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.874997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.875306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.875636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.875965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.876275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.876624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.876950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.877275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.877599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.877904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.878223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.878540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.878867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.879177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.879490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.879745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.880056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.880384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.880736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.881062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.881231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 21:20:12.881717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.881867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 21:20:12.882019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.882174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 21:20:12.882316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.882316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.882683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 21:20:12.882683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 21:20:12.883523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.883523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.883820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.883993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.884957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.885909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.886910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-828807-3-iscsi {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.887921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.888940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.889100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.889243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.889396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.889555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.890401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.890562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.890713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.890910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.891969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.892987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.893895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-828807-3-iscsi {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.894912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.895571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.895735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.895889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.896969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.897866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.898007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.898303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.899108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.899274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.899426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.899587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.899739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.900601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.900776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.900944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.901976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.902978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.903906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.904962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.905860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.906911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.907305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.907451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.907592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.907740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.907899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.908875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.909038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.909380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.909537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.909687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.909845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.910015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.910757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.910916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.911063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.911214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.911366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.911570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.911757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.912081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.912258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.912493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.912669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.912828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.912971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.913122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.913271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.913427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.913570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.913712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.913872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.914641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.914795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.914955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.915105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.915250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.915250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.915519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.915667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.915817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.915971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.916120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.916272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.916426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.916639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.916805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.916949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.917090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.917231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.917373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.917530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.917694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.917846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.917995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.918139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.918279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.918445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.918587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.918729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.918729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.918995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.919146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.919368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.919513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.919654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.919795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.919941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.920083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.921313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.922512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.922908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.923520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.923822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.924072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.924333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.924620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.924891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.925134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.925389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.925654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.925927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.926175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.926410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.926662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.926897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.927160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.927466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.927797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.928047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.928284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.928529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.928818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.929058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.929313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.929566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.930333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.931806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.932074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.932318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.932493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.932669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.932848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.933112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.933262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.933403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.933559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.933717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.933920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.934070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.934226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.934369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.934519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.934704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.934858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.935009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.935170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.935555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.935712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.935870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.936021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.936166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.936318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.936461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.936827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.936984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.937142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.937303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.937448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.937553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.937640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.937730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.937822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.937822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.937985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 21:20:12.938315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.938961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.939891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.940889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.941244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.941363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.942996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.943937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.944894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.945059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.945150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.945244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.945896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.946935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.947976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.948767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.949919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.950906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.951998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.952142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.952302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.952470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.952707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.952861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.957867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.958871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.959996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.960135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.960280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.960414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.960555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.960795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.961033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.961966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.961966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.962230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.962398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.962567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.963882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.964862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.965918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966692 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.966933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.967975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.968117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.968257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.968257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.968732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.968871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.969981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.970955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.971144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.971277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.971407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.971549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.971702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.972095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.972246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.972391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.972526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.974886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.975918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.976925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.977913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.978929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.979916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.980057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.980057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.980057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.980057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.980576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.981902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.982952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.983951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.984116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.984255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.984402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.984538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.990561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.990686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.990785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.990863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.990974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.991936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.992999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.993924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.994933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.995913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.996913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.997953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.998987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:12.999916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.000986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.001938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.002987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.003864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.004922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.005945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.006984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.007734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.008978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.009989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.010861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.011960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.012996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.013889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.014808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.015962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.016923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.017860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.018834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.019999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.020972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.021989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.022957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.023176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.023277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.024875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.025853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.026823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.027789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.028983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.029921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.030975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.031929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.032409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.032513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.032752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.032878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.033994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.034930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.035853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.036979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.037937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.038121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.038369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.038469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.038693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.038795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.039979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.040970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.041931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.042985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.043210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.043312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.043518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.043615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.043825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.044776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.045961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.046901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.047980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.048933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.049890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.050849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.051824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.052788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.053947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.054046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.054262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.054377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.054576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.054715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.055869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.056847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.057993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.058933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.059909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.060894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.061872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.062910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.063870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.064825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.065984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.066928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.067879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.068899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.069887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.070103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.070208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.070951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.071985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.072952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073584 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.073883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.074114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.074331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.074438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.074686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.074995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.075970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.076946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.077983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.078914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.079910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.080844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.081981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.082997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.083961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.084920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.085977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.086665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.086763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.086977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.087937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.088944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.089177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.089270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.089514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.089751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.089859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.090862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.091835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.092802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.093946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.094176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.094270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.094532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.094634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.094973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.095879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.096854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.097809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.098966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.099908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.100999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.101995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.102968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.103942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.104958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.105938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.106958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.107896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.108114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.108208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.108428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.108530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.108780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.109828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.110936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.111911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.112910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.113838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.114789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.115943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.116939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.117031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.117797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.117904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.118858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.119811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.120811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.121990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.122962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.123900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.124970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.125943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.126898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.127885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.128871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.129033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.129142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.129281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118355) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:20:13.129376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.129644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.129960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.130275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.130589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.130903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.131225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.131541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.131856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.132174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.132485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.133375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.133702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.134015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.134328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.134675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.135018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.135339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.135669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.135990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.136318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.136659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.136990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.137322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.137647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.137963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.138305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.138626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.138948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.139263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.139583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.139901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.140218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.140556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.140915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.141235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.141571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.141899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.142228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.142553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.142876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.143218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.143538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.143877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.144207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.144490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.144838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.145164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.145489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.145826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.146164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.146488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.146821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.147156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.147514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.147837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.148192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.148568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.148914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.149237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.149551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 21:20:13.149803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118354) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 21:20:13.189720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO dbcounter [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Registered counter for database nova_api May 26 21:20:13.210199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.210811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO dbcounter [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Registered counter for database nova_api May 26 21:20:13.217661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writer thread running {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.230766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_db.sqlalchemy.engines [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.238312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writer thread running {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.274773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.context [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97faeabc-1cd1-4d3b-8b75-7848ba9e27ca(cell1) {{(pid=118355) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:20:13.278951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:20:13.280529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:20:13.281362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:20:13.283630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:20:13.285635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO dbcounter [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Registered counter for database nova_cell0 May 26 21:20:13.289662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO dbcounter [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Registered counter for database nova_cell1 May 26 21:20:13.296083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.context [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),97faeabc-1cd1-4d3b-8b75-7848ba9e27ca(cell1) {{(pid=118354) load_cells /opt/stack/nova/nova/context.py:464}} May 26 21:20:13.296541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.299823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.300356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:20:13.302023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:20:13.302854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:20:13.305503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:20:13.306987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writer thread running {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.307622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO dbcounter [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Registered counter for database nova_cell0 May 26 21:20:13.308291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writer thread running {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.311778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO dbcounter [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Registered counter for database nova_cell1 May 26 21:20:13.321706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_db.sqlalchemy.engines [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.322805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_db.sqlalchemy.engines [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.329661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writer thread running {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.330945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writer thread running {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.459561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO dbcounter [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Registered counter for database nova_cell0 May 26 21:20:13.466638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_db.sqlalchemy.engines [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118355) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.472362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writer thread running {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.479938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO dbcounter [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Registered counter for database nova_cell0 May 26 21:20:13.488922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_db.sqlalchemy.engines [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118354) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 21:20:13.494275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writer thread running {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 21:20:13.798000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: WARNING keystonemiddleware.auth_token [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:20:13.805693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: WARNING keystonemiddleware.auth_token [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:20:13.845356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: WARNING keystonemiddleware.auth_token [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:20:13.853296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: WARNING keystonemiddleware.auth_token [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:20:14.157890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: WARNING keystonemiddleware.auth_token [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:20:14.165183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: WARNING keystonemiddleware.auth_token [None req-1ce63e5d-77eb-45b2-a292-b95749c01683 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:20:14.170542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55692633e9c0 pid: 118355 (default app) May 26 21:20:14.205052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: WARNING keystonemiddleware.auth_token [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 26 21:20:14.211229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: WARNING keystonemiddleware.auth_token [None req-df0e9cd9-fa6b-4ea3-88dc-9880fa374ce1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 26 21:20:14.216704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55692633e9c0 pid: 118354 (default app) May 26 21:20:57.162771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.163970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.165150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.166012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.684942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.686454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.687380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:57.689021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:20:58.596773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e38ac925-0a8b-4531-b659-90763fafd3db tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Action: 'create', calling method: .version_select at 0x7f46ca1f0c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1094406836", "metadata": {"Type": "work"}}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:20:59.004878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1608858780", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "networks": [{"uuid": "5a393e7f-c0aa-4e22-b669-aa0bb6426eaf"}]}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:20:59.627738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] validate_networks() for [('5a393e7f-c0aa-4e22-b669-aa0bb6426eaf', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:00.648464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e38ac925-0a8b-4531-b659-90763fafd3db tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.471206 May 26 21:21:00.648464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Thu May 26 21:20:57 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3474 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 26 21:21:00.648464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e27f950a-24d4-43ad-bdd9-ecae13889ecf tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46ca03eb80>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:00.789500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e27f950a-24d4-43ad-bdd9-ecae13889ecf tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 200 len: 353 microversion: 2.1 time: 0.151447 May 26 21:21:00.790717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 2/2] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:00 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:21:01.149613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:01.150812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:01.151482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:01.152692 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:01.153312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:01.175810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:01.176484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:01.179216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:01.180806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:01.233162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Getting quotas for project 90703a330f8940989ec1fa3b82fe4976. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:01.241411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Getting quotas for user ce2de523c23948c8b9b652c9263b9240 and project 90703a330f8940989ec1fa3b82fe4976. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:01.256609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:01.272983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:01.513032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-09c52cc3-c87b-4b2c-872b-047e3f1f5f25 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.838559 May 26 21:21:01.513924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:20:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:21:01.524875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33bd0cfa-6fc3-4a15-a82d-09054bdb5dd3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:01.525973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33bd0cfa-6fc3-4a15-a82d-09054bdb5dd3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:01.690097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33bd0cfa-6fc3-4a15-a82d-09054bdb5dd3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:01.717568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33bd0cfa-6fc3-4a15-a82d-09054bdb5dd3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1215 microversion: 2.1 time: 0.196457 May 26 21:21:01.732887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:01 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:01.803592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d23fc485-cbc5-43f9-9a3b-43749e467dbf tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46c9febc10>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:02.052941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d23fc485-cbc5-43f9-9a3b-43749e467dbf tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 200 len: 353 microversion: 2.1 time: 0.253829 May 26 21:21:02.056631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:01 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 353 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:02.744480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9969e1fb-4633-4877-b839-7df23c460445 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:02.744480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9969e1fb-4633-4877-b839-7df23c460445 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:02.875702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9969e1fb-4633-4877-b839-7df23c460445 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:02.886060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9969e1fb-4633-4877-b839-7df23c460445 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1215 microversion: 2.1 time: 0.153243 May 26 21:21:02.889013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:02 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:03.091150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-42ad43dd-506a-4ddb-9b23-a4f669911925 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46c8f605e0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:03.220174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-42ad43dd-506a-4ddb-9b23-a4f669911925 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 200 len: 354 microversion: 2.1 time: 0.154246 May 26 21:21:03.230562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 3/7] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:03 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:03.234222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5d3c87f8-b888-44c7-83d1-e792eedce572 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46ca01ac10>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:03.369601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5d3c87f8-b888-44c7-83d1-e792eedce572 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 200 len: 354 microversion: 2.1 time: 0.137618 May 26 21:21:03.373633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 5/8] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:03 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 354 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:03.387532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d611424d-6180-489e-b19f-3bec6e2cb881 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46c8f60ca0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:03.699916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d611424d-6180-489e-b19f-3bec6e2cb881 tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 202 len: 0 microversion: 2.1 time: 0.317147 May 26 21:21:03.700563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 4/9] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:21:03 2022] DELETE /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:21:03.720832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f4893010-5bd4-44eb-9492-c2ab6f84e8ab tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46ca0243a0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:03.816406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f4893010-5bd4-44eb-9492-c2ab6f84e8ab tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 200 len: 353 microversion: 2.1 time: 0.110812 May 26 21:21:03.817863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 6/10] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:03 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:03.905899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4abe6366-88e5-4a3b-9c65-c1ee9ab9d1bf tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:03.909373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4abe6366-88e5-4a3b-9c65-c1ee9ab9d1bf tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:04.194846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4abe6366-88e5-4a3b-9c65-c1ee9ab9d1bf tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:04.218002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4abe6366-88e5-4a3b-9c65-c1ee9ab9d1bf tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1215 microversion: 2.1 time: 0.315722 May 26 21:21:04.219252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 5/11] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:03 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:04.831271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-815c9266-bac9-4e40-aa77-d70faa66c3ae tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Calling method '.version_select at 0x7f46ca01ae50>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:04.876086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-815c9266-bac9-4e40-aa77-d70faa66c3ae tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] HTTP exception thrown: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-815c9266-bac9-4e40-aa77-d70faa66c3ae tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Request method failure captured: May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 HTTP/1.1 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-85x6iRvJYGikXjGhEVYb3Ul5bcf7Q2OdlFeoKLsOQHQMzM632bTUOMb_ylTNs7wCQXxxIhLdsAOZuRna5lg-RPx8AT5EiQMKEv0_H8Pu4rbu4VtV5TrLlPF1pGOY5pkVq8A9qeqwhnZ43YwZo3Ew744PaEWziYgqUch8OaniqHT5w May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 7bf89680201948a69270b2c1d8d59a74 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesGetTestJSON-1682729619 May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:21:04.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7bf89680201948a69270b2c1d8d59a74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7bf89680201948a69270b2c1d8d59a74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7bf89680201948a69270b2c1d8d59a74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7bf89680201948a69270b2c1d8d59a74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesGetTestJSON-1682729619 May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 7bf89680201948a69270b2c1d8d59a74 May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesGetTestJSON-1682729619 May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesGetTestJSON-1682729619-project May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b5c38bac14d846a698af265cf50fd6a2 May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesGetTestJSON-1682729619-project May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '4c10df2b-512b-4866-9dac-04e94edc7734'} May 26 21:21:04.884419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. (HTTP 404) (Request-ID: req-421f0ee6-948a-43ab-a94b-1ac8963a0d0a) May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:04.885256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:21:04.886272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:21:04.887741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. May 26 21:21:04.888902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:04.893036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-815c9266-bac9-4e40-aa77-d70faa66c3ae tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] Returning 404 to user: Volume 4c10df2b-512b-4866-9dac-04e94edc7734 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:04.894219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-815c9266-bac9-4e40-aa77-d70faa66c3ae tempest-VolumesGetTestJSON-1682729619 tempest-VolumesGetTestJSON-1682729619-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734" status: 404 len: 109 microversion: 2.1 time: 0.068359 May 26 21:21:04.895040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 7/12] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:04 2022] GET /compute/v2.1/os-volumes/4c10df2b-512b-4866-9dac-04e94edc7734 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:21:05.243950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:05.245279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:05.264459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:05.265352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:05.273036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:05.273503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:06.145681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:06.173889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ad21119-e4e1-47d8-aa4f-554cf64344a6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1219 microversion: 2.1 time: 0.934973 May 26 21:21:06.174890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 6/13] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:05 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1219 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:07.191571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:07.194391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:07.207906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:07.208638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:07.209677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:07.212433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:07.898482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:07.920353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d61e61d7-6ab3-49e8-a86d-1210384de1b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1285 microversion: 2.1 time: 0.733108 May 26 21:21:07.933369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:07 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1285 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:08.962236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:08.975055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:08.976672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:08.977257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:08.983095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:08.984814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:09.423751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:09.431033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbd00495-7808-4ad0-bc3b-b73b7939a085 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1273 microversion: 2.1 time: 0.474046 May 26 21:21:09.436881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 7/15] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:08 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1273 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:10.457429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:10.458203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:10.488328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:10.488825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:10.499330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:10.504064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:10.770671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:10.783522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71ae6ef2-1150-4b93-b441-a4c1d61f406e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1273 microversion: 2.1 time: 0.332721 May 26 21:21:10.784425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:10 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1273 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:11.808430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:11.811752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:11.811752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:11.827020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:11.833909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:11.857679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:11.857679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:13.059242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:13.073642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9b503978-7855-448a-890a-862990df00b0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 1.269484 May 26 21:21:13.077441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 8/17] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:11 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:13.299918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:13.914592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a6dcf36-453f-4a04-aad8-bcd6b752137d tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Action: 'create', calling method: .version_select at 0x7f46c9ebcca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1752511414", "metadata": {"Type": "work"}}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a6dcf36-453f-4a04-aad8-bcd6b752137d tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 122 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:21:13.930300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1752511414", "metadata": {"Type": "work"}}} May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: May 26 21:21:13.931557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1752511414', 'metadata': {'Type': 'work'}}}} May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise error May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi '#$%' May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:13.932352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:21:13.933707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:21:13.934969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 26 21:21:13.934969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.936018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a6dcf36-453f-4a04-aad8-bcd6b752137d tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:13.937536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0a6dcf36-453f-4a04-aad8-bcd6b752137d tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.654585 May 26 21:21:13.945428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 10/18] 10.222.0.66 () {60 vars in 1155 bytes} [Thu May 26 21:21:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 659 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:21:13.951604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-49b627fe-51e9-41d6-b461-7931f80c7abf tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Action: 'create', calling method: .version_select at 0x7f46c8e47670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2090554699", "metadata": {"Type": "work"}}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-49b627fe-51e9-41d6-b461-7931f80c7abf tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 120 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:21:13.957999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2090554699", "metadata": {"Type": "work"}}} May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:21:13.959629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2090554699', 'metadata': {'Type': 'work'}}}} May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise error May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi '0' May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:13.960242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:21:13.961668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:21:13.962615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 26 21:21:13.962615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:13.964343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-49b627fe-51e9-41d6-b461-7931f80c7abf tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:13.965437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-49b627fe-51e9-41d6-b461-7931f80c7abf tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018640 May 26 21:21:13.973292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 9/19] 10.222.0.66 () {60 vars in 1155 bytes} [Thu May 26 21:21:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:21:13.979444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3162395e-2390-4d62-974f-5f2a390fa6d7 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Action: 'create', calling method: .version_select at 0x7f46c9eddb80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1085713096", "metadata": {"Type": "work"}}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3162395e-2390-4d62-974f-5f2a390fa6d7 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 119 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:21:13.984145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1085713096", "metadata": {"Type": "work"}}} May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: May 26 21:21:13.985362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1085713096', 'metadata': {'Type': 'work'}}}} May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise error May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi On instance['volume']: May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi '' May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:13.985999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 26 21:21:13.992246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 26 21:21:13.993265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 26 21:21:13.993265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:21:13.993265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3162395e-2390-4d62-974f-5f2a390fa6d7 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:13.993265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3162395e-2390-4d62-974f-5f2a390fa6d7 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010375 May 26 21:21:13.996330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1155 bytes} [Thu May 26 21:21:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:21:13.997247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba4925e3-32ee-40a7-b462-4cdd3ffcc5e6 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Calling method '.version_select at 0x7f46c8e691f0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:14.092524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-ba4925e3-32ee-40a7-b462-4cdd3ffcc5e6 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] HTTP exception thrown: Volume tempest-invalid-568106667 could not be found. May 26 21:21:14.095688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:14.096308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba4925e3-32ee-40a7-b462-4cdd3ffcc5e6 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-568106667 HTTP/1.1 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:21:14.097656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Volume tempest-invalid-568106667 could not be found. May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'tempest-invalid-568106667'} May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:14.098906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-568106667 could not be found. (HTTP 404) (Request-ID: req-f708b75a-c792-44ed-8ef1-f7d9881908c7) May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.099737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:21:14.100830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-568106667 could not be found. May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:21:14.101796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-568106667 could not be found. May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-568106667 could not be found. May 26 21:21:14.102882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.104907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba4925e3-32ee-40a7-b462-4cdd3ffcc5e6 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 404 to user: Volume tempest-invalid-568106667 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:14.106234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba4925e3-32ee-40a7-b462-4cdd3ffcc5e6 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-568106667" status: 404 len: 98 microversion: 2.1 time: 0.113677 May 26 21:21:14.107361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1214 bytes} [Thu May 26 21:21:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-568106667 => generated 98 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 26 21:21:14.113101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:14.113561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:14.114919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:14.115407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:14.133698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b032400-c647-4833-9f75-043d7aab534b tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.019752 May 26 21:21:14.138260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 11/22] 10.222.0.66 () {58 vars in 1139 bytes} [Thu May 26 21:21:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 25 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 21:21:14.154451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a81cd208-1637-4b42-a09e-29430342e4c9 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008259 May 26 21:21:14.155868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1136 bytes} [Thu May 26 21:21:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 26 21:21:14.177906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b77cc948-2773-4c62-a483-284496635df5 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Calling method '.version_select at 0x7f46c8e69b80>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:14.213808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=8 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:14.271943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-b77cc948-2773-4c62-a483-284496635df5 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] HTTP exception thrown: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b77cc948-2773-4c62-a483-284496635df5 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/os-volumes/b93464cc-d769-49b7-a4b5-3f7ec5ddeddb HTTP/1.1 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:21:14.274646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'b93464cc-d769-49b7-a4b5-3f7ec5ddeddb'} May 26 21:21:14.276117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. (HTTP 404) (Request-ID: req-9a35df88-3929-4c32-a0e2-2e621add8e72) May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.276970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:21:14.282210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:21:14.283221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b77cc948-2773-4c62-a483-284496635df5 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 404 to user: Volume b93464cc-d769-49b7-a4b5-3f7ec5ddeddb could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b77cc948-2773-4c62-a483-284496635df5 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/b93464cc-d769-49b7-a4b5-3f7ec5ddeddb" status: 404 len: 109 microversion: 2.1 time: 0.105417 May 26 21:21:14.284260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 13/24] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:21:14 2022] DELETE /compute/v2.1/os-volumes/b93464cc-d769-49b7-a4b5-3f7ec5ddeddb => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:21:14.291520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-89cb2861-f270-4522-ac9f-a2c383d83950 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Calling method '.version_select at 0x7f46c8e47ee0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:14.404396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-89cb2861-f270-4522-ac9f-a2c383d83950 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] HTTP exception thrown: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-89cb2861-f270-4522-ac9f-a2c383d83950 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Request method failure captured: May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/os-volumes/74c41b46-9d46-4a82-8a04-030b2b27f75b HTTP/1.1 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9JdqYtodxUC_zKZOxpdCH5r95SE3jvY5zfC9PQyih8rFXmFiFHIxQ3-azUQvr0hm_yEkNav_1Ztwm2-8EKt3__vaX9-8ibYyhdZnhaRBCpTgLOhWywtWp8onWtk3811Zcgpp8lhm93fVWizgVpiN5zrv2k8MIJqBv-Xg7TClQQ538 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:21:14.407905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/34feefe885274fb8bf2e83cbcb8c37d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 34feefe885274fb8bf2e83cbcb8c37d5 May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesNegativeTest-12737793 May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 47a99f5000e54e628a371e8731871e55 May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesNegativeTest-12737793-project May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '74c41b46-9d46-4a82-8a04-030b2b27f75b'} May 26 21:21:14.409207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. (HTTP 404) (Request-ID: req-aa64352c-aaff-4d74-acb0-55952da9f0e0) May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.409907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:21:14.410895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:21:14.412346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. May 26 21:21:14.413347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:21:14.414938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-89cb2861-f270-4522-ac9f-a2c383d83950 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] Returning 404 to user: Volume 74c41b46-9d46-4a82-8a04-030b2b27f75b could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:21:14.416234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-89cb2861-f270-4522-ac9f-a2c383d83950 tempest-VolumesNegativeTest-12737793 tempest-VolumesNegativeTest-12737793-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/74c41b46-9d46-4a82-8a04-030b2b27f75b" status: 404 len: 109 microversion: 2.1 time: 0.132409 May 26 21:21:14.424670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 14/25] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:21:14 2022] GET /compute/v2.1/os-volumes/74c41b46-9d46-4a82-8a04-030b2b27f75b => generated 109 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:21:15.416174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:15.431760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5cdb813d-70b9-41ea-90c5-79f8e0844ac1 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 1.337860 May 26 21:21:15.446364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 12/26] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:14 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:16.186775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-713729981", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:16.352675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] validate_networks() for [('b8c11c11-1739-452e-815b-7cbdb8ce7807', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:16.453224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:16.454572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:16.466000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:16.466932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:16.467884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:16.468525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:17.834331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:17.863348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2e36f286-2a54-4a08-a669-6c6046ed895a tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 1.415305 May 26 21:21:17.868345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 13/27] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:16 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:18.445346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1006dcbb-4b86-4c59-9fba-88dcdabd45d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'create', calling method: .version_select at 0x7f46c9eea0d0>, body: {"keypair": {"name": "tempest-keypair-1903541608", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmFH12KHInqWDbjJYwy2klogn+zHEz565pIvt8sHL6+6koBBfBYn4IuOTqAbGJIQh19p3lPa51ezb6VGwLtesUyjkl8DMSHjA4+OKJP+JDg6P9puqMG6eHuRyjzjCcCJg=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:18.638467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-1006dcbb-4b86-4c59-9fba-88dcdabd45d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:18.657963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-1006dcbb-4b86-4c59-9fba-88dcdabd45d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for user 7d524a8208354c2099eb3b41b0f53de2 and project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:18.861787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1006dcbb-4b86-4c59-9fba-88dcdabd45d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.975542 May 26 21:21:18.863155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 14/28] 10.222.0.66 () {62 vars in 1199 bytes} [Thu May 26 21:21:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 994 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 21:21:18.885537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:18.886173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:18.898552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:18.899013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:18.914461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:18.918200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.073022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:19.073516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:19.074576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:19.075024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:19.076170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:19.093562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:19.097590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.103761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:19.104719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.146363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:19.152011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for user 23ed95370bfd46e3a1c6946701e66065 and project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:19.170090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:19.173864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:19.308107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f18ec336-3a12-4143-b632-aa3845d25b6d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.583680 May 26 21:21:19.312244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 15/29] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:21:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:21:19.560043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:19.585016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-76afd4e0-278c-4d48-b77f-12860cd08672 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.700895 May 26 21:21:19.587386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 15/30] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:18 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:19.602578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4f86620a-8245-4bad-bcf4-a73d56720cae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:19.604865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4f86620a-8245-4bad-bcf4-a73d56720cae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:19.624466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-eb477101-0baa-4052-9ced-08a4e903098d req-de303deb-13f8-498c-b260-4505685483ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3546719-ea65-4d99-bb86-ae1d6c62a867", "tag": "a6173aff-5c1e-4cda-b784-150fc80aa28a"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:19.662704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-eb477101-0baa-4052-9ced-08a4e903098d req-de303deb-13f8-498c-b260-4505685483ea service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:19.665425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-eb477101-0baa-4052-9ced-08a4e903098d req-de303deb-13f8-498c-b260-4505685483ea service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.753823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-eb477101-0baa-4052-9ced-08a4e903098d req-de303deb-13f8-498c-b260-4505685483ea service nova] Creating event network-changed:a6173aff-5c1e-4cda-b784-150fc80aa28a for instance d3546719-ea65-4d99-bb86-ae1d6c62a867 on hv-cinder-82880 May 26 21:21:19.756451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-eb477101-0baa-4052-9ced-08a4e903098d req-de303deb-13f8-498c-b260-4505685483ea service nova] Acquired lock "compute-rpcapi-router" {{(pid=118354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 21:21:19.756451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:19.771086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.780188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:19.780188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:19.808201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4f86620a-8245-4bad-bcf4-a73d56720cae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:19.817104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4f86620a-8245-4bad-bcf4-a73d56720cae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1221 microversion: 2.1 time: 0.227936 May 26 21:21:19.826146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 16/31] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:19 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1221 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:19.864449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.compute.rpcapi [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 21:21:19.877664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] Releasing lock "compute-rpcapi-router" {{(pid=118354) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 21:21:19.945552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44160618-b61f-4b42-aa43-4602bbbec3e3 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.628946 May 26 21:21:19.951331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:20.527801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2138529573", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:20.718680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] validate_networks() for [('b8c11c11-1739-452e-815b-7cbdb8ce7807', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:21.072836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a8c2370a-5462-4b47-a1b7-76b865713fc1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: .version_select at 0x7f46c95f84c0>, body: {"keypair": {"name": "tempest-keypair-1193779185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqo2qs+G2E7qUuNCtyCL3PML859MabERG95CJ56rwZdl8DWNH8AIC31mHOhjMtaP/j7Wio2CfS9PEMPHMU9vqDS2AVG/S/F+R5mZA42HmQGuL2nvpkDDF47lknxaWipCQ=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:21.117098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-a8c2370a-5462-4b47-a1b7-76b865713fc1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:21.127390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-a8c2370a-5462-4b47-a1b7-76b865713fc1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:21.268662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a8c2370a-5462-4b47-a1b7-76b865713fc1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.382585 May 26 21:21:21.269019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 17/33] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:21:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:21:21.274224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:21.275841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:21.298415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:21.299397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:21.300425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:21.303519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:22.282960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:22.300867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-26873a26-090c-4acd-8ad6-08102779faca tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 1.030100 May 26 21:21:22.303574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 18/34] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:21 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:22.612769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f04f7160-9105-47ca-818a-7c60ec878dae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: .version_select at 0x7f46c9e5eaf0>, body: {"keypair": {"name": "tempest-keypair-740393474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHArpwLnRCQym/M67YkCn/4HU/PINLuCG1UKpbbSK8vSLW5WP4D+X4kZsfEKWFVi+FUB6EU2jJdmbBBP8WotZ7ngazJ1qFtmotRARSA+pLN6c4ZKDNJjressdnqFxnDo/w=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:22.674634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-f04f7160-9105-47ca-818a-7c60ec878dae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for project 8e24cfce792042e2b665ef2cca91b752. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:22.703770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-f04f7160-9105-47ca-818a-7c60ec878dae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for user 388330e61ade4f188c40c11c4ac46fd0 and project 8e24cfce792042e2b665ef2cca91b752. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:22.824597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:22.825141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:22.825518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:22.825933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:22.835031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:22.845532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f04f7160-9105-47ca-818a-7c60ec878dae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.532967 May 26 21:21:22.846596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 19/35] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:21:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:22.903958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:22.904907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:22.905833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:22.906287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:23.053383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:23.094713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for user 23ed95370bfd46e3a1c6946701e66065 and project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:23.162735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:23.169848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:23.319265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:23.320567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:23.335217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:23.336278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:23.339287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:23.343557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:23.506530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9acc5de2-c57e-4f60-9fa7-bf488d46c0fa tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.983892 May 26 21:21:23.512709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 17/36] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:21:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:21:23.549789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-75cb1ce5-a02d-46f4-87e2-f51a03016856 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:23.555078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-75cb1ce5-a02d-46f4-87e2-f51a03016856 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:24.074099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-75cb1ce5-a02d-46f4-87e2-f51a03016856 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:24.083187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-75cb1ce5-a02d-46f4-87e2-f51a03016856 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1222 microversion: 2.1 time: 0.565229 May 26 21:21:24.096151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 18/37] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:23 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1222 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:25.003254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:25.013207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0cadc3b-47d1-4ac3-ac62-a17e3a032685 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 1.699164 May 26 21:21:25.013801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 20/38] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:23 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:25.103820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-294b6b5a-3e03-45f5-9a7f-1482d9cbcc86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:25.105079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-294b6b5a-3e03-45f5-9a7f-1482d9cbcc86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:25.497041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-294b6b5a-3e03-45f5-9a7f-1482d9cbcc86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:25.506110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-294b6b5a-3e03-45f5-9a7f-1482d9cbcc86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1222 microversion: 2.1 time: 0.407498 May 26 21:21:25.517013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 19/39] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:25 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1222 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:26.035435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:26.044899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:26.063021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:26.065664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:26.068885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:26.069630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:26.523358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:26.523985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:26.540472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:26.540967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:26.541763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:26.542216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:26.823303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:26.839357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b8e781c-123d-439c-ac8d-f862c65a93f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1274 microversion: 2.1 time: 0.319851 May 26 21:21:26.882339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 20/40] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:26 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1274 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:26.917694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:26.928172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0fd50506-91d3-43a2-8eca-51c67c484736 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.901111 May 26 21:21:26.931469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 21/41] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:26 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:27.864265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:27.864927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:27.875747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:27.876231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:27.878920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:27.886296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:27.952663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:27.954267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:27.956317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:27.971321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:27.977971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:27.979962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:27.981292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:27.992133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=49 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:28.081564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:28.104388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a99ee5a7-b7da-4c7b-8909-153b3234060a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1274 microversion: 2.1 time: 0.238216 May 26 21:21:28.108538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 21/42] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:27 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:28.467114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:28.484006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-732162a4-3f28-4bfe-ae28-1f65a670cd86 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.543764 May 26 21:21:28.515308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 22/43] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:27 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:28.702518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1154153775", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a507481f-71f1-4c10-ab11-2f99d3b1809b"}], "security_groups": [{"name": "tempest-securitygroup--1273484286"}], "key_name": "tempest-keypair-1903541608", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:28.716352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=9 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:28.906087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] validate_networks() for [('a507481f-71f1-4c10-ab11-2f99d3b1809b', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:29.141794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:29.144946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:29.161381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:29.162072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:29.191113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:29.194564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:29.604031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:29.615693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f7af5e8f-aec2-49dd-a99c-375ff99dbe50 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1274 microversion: 2.1 time: 0.491191 May 26 21:21:29.616910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 23/44] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:29 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1274 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:29.625722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1048701717", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e07a43e-b6dc-4850-bc07-d904a80346a4"}], "security_groups": [{"name": "tempest-securitygroup--684374184"}], "key_name": "tempest-keypair-1193779185", "user_data": "}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:30.074130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] validate_networks() for [('4e07a43e-b6dc-4850-bc07-d904a80346a4', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:30.522349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:30.523404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:30.524023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:30.524681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:30.525304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:30.546099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:30.546552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:30.547359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:30.550192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:30.590487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=41 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:30.624113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:30.636846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for user 7d524a8208354c2099eb3b41b0f53de2 and project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:30.659277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:30.663177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:30.859244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8acca964-70d0-4ce5-aedd-110638f23238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.163764 May 26 21:21:30.861844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 22/45] 10.222.0.66 () {62 vars in 1187 bytes} [Thu May 26 21:21:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 21:21:30.881762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:30.883626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:30.897038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:30.897719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:30.898794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:30.899426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:31.521738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:31.531389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8d629ef0-572f-4b8d-9974-b20e3630dd9f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.666812 May 26 21:21:31.533258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 23/46] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:30 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:31.541807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:31.544611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:31.550273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:31.551105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:31.552727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:31.553413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:31.655351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:31.658579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d1fda499-38f6-482c-bacb-f467dfc42977 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1274 microversion: 2.1 time: 0.124045 May 26 21:21:31.664969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 24/47] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:31 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:31.670772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1364936676", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93529f0f-54f7-46c5-b68f-8eddc26d3812"}], "security_groups": [{"name": "tempest-securitygroup--220198997"}], "key_name": "tempest-keypair-740393474", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:31.929980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] validate_networks() for [('93529f0f-54f7-46c5-b68f-8eddc26d3812', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:21:32.077702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:32.078237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:32.078693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:32.079169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:32.079654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:32.096630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.098808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.101152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.102708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.131589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:32.141747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:32.171958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:32.175057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:32.430086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d479d64c-2a4d-40d3-9c16-4a8ed1062941 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.808118 May 26 21:21:32.431132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 24/48] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:21:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:21:32.444168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:32.447607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:32.571495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:32.581481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:32.583576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:32.584877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-349da41e-993a-4a68-b9b0-ceb2b49a01cb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1282 microversion: 2.20 time: 0.150217 May 26 21:21:32.586481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:32 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:32.626961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:21:32.627427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:21:32.627940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:21:32.628477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:21:32.628917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:21:32.637804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.638624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.639413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.639848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.664745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for project 8e24cfce792042e2b665ef2cca91b752. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:21:32.666587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-ec5edba8-63ef-49b3-b2a8-ee9dbd3eaa79 req-42cc75ef-b400-4065-8f79-494d53d92103 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3", "tag": "d5a7772c-a49f-4686-b4ba-78b4ac8f17bf"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:32.666952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for user 388330e61ade4f188c40c11c4ac46fd0 and project 8e24cfce792042e2b665ef2cca91b752. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:21:32.678393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ec5edba8-63ef-49b3-b2a8-ee9dbd3eaa79 req-42cc75ef-b400-4065-8f79-494d53d92103 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.678847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ec5edba8-63ef-49b3-b2a8-ee9dbd3eaa79 req-42cc75ef-b400-4065-8f79-494d53d92103 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.679515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:21:32.681885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:21:32.709397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-ec5edba8-63ef-49b3-b2a8-ee9dbd3eaa79 req-42cc75ef-b400-4065-8f79-494d53d92103 service nova] Creating event network-changed:d5a7772c-a49f-4686-b4ba-78b4ac8f17bf for instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 on hv-cinder-82880 May 26 21:21:32.709872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ec5edba8-63ef-49b3-b2a8-ee9dbd3eaa79 req-42cc75ef-b400-4065-8f79-494d53d92103 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 26 21:21:32.711026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.711467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.712246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.712754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.721503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.compute.rpcapi [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 26 21:21:32.722379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] Releasing lock "compute-rpcapi-router" {{(pid=118355) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 26 21:21:32.738647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-123094b1-dbc1-4c19-ab0d-bf0f2c401eb3 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150751 May 26 21:21:32.743186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 26/50] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:32.744427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-881c76d3-6eab-4a3d-9d21-61a064aca0b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:32.745219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-881c76d3-6eab-4a3d-9d21-61a064aca0b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:32.839806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-881c76d3-6eab-4a3d-9d21-61a064aca0b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:32.848976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-881c76d3-6eab-4a3d-9d21-61a064aca0b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1242 microversion: 2.1 time: 0.107732 May 26 21:21:32.860355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 27/51] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1242 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:32.866637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:32.867546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:32.875762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.876530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.877539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.878167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.928535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8bc6a454-6f74-49ec-b027-2f7aadfda079 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.253983 May 26 21:21:32.929312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 25/52] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:21:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:21:32.961327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:32.962843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:32.971124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.972042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:32.974090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:32.974917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:33.168103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.168103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2d4d1d07-eecc-4860-a012-d8d216bf551d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1274 microversion: 2.1 time: 0.208334 May 26 21:21:33.168103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 26/53] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:32 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1274 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:33.168103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3d2aeb3d-6f99-4a4d-a085-3aa366360908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:33.168507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3d2aeb3d-6f99-4a4d-a085-3aa366360908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:33.294753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3d2aeb3d-6f99-4a4d-a085-3aa366360908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.302987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3d2aeb3d-6f99-4a4d-a085-3aa366360908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1237 microversion: 2.1 time: 0.144206 May 26 21:21:33.303912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 27/54] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1237 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:33.331734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.340724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e160aea2-e5e3-4150-a42a-175408547711 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.478867 May 26 21:21:33.341552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 28/55] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:32 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:33.604387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:33.605127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:33.613169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:33.613583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:33.614577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:33.615073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:33.711517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.716042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.720830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.722559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c6b7dbb2-e94a-40d2-969b-1bade3a22070 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.122013 May 26 21:21:33.723894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 28/56] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:33 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:33.867729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7f8390b1-96be-416f-af69-7e858678cfeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:33.868370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7f8390b1-96be-416f-af69-7e858678cfeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:33.932628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7f8390b1-96be-416f-af69-7e858678cfeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:33.940304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7f8390b1-96be-416f-af69-7e858678cfeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1242 microversion: 2.1 time: 0.077124 May 26 21:21:33.941164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 29/57] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:34.174546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:34.175173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:34.181561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.182017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.182800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.183267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.315204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.315204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b901729e-8c65-4dbb-82c7-1ea7512d2a0c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.135791 May 26 21:21:34.315204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 29/58] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:34 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:34.319257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-552faa8d-2cbb-4f3a-a515-7423db0b752e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:34.319862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-552faa8d-2cbb-4f3a-a515-7423db0b752e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:34.358199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:34.358814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:34.365245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.365755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.366481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.366916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.375826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-552faa8d-2cbb-4f3a-a515-7423db0b752e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.383126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-552faa8d-2cbb-4f3a-a515-7423db0b752e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1237 microversion: 2.1 time: 0.067815 May 26 21:21:34.383712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 30/59] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:34.506245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.514113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d14e1b6d-59d7-4d70-bff3-98a6fca05879 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.159837 May 26 21:21:34.514860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 30/60] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:34 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:34.744920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:34.744920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:34.749188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.749642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.750444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.750886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.811598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.819870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.821505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:34.822617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9571af25-fbf1-4820-9c7a-7b565e5357f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.084686 May 26 21:21:34.823184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 31/61] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:34 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:34.957961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:34.958598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:34.964930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.965374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:34.966126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:34.966573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.035137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.044108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1f7fb3c9-52c8-4f34-ab23-9b0568aceac2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.090412 May 26 21:21:35.044787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 31/62] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:35.331373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:35.331997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:35.338209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.338660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.339424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.339866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.399853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:35.400449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:35.403190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.409058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.410018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.411553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.411933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.412118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5bfed46d-bc8c-496e-922d-cc1051bd2ae8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.084510 May 26 21:21:35.413150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 32/63] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:35 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:35.480899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.489243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3c245ddf-bc4d-4ea5-8fcb-21b986ebe6c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.093023 May 26 21:21:35.489860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 32/64] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:35.531889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:35.532720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:35.539525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.540058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.540954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.541469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.671686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.679461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc798756-195b-4839-803a-c739c881d76c tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.151836 May 26 21:21:35.680724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 33/65] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:35 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:35.842080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:35.842898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:35.849783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.850241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.851007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:35.851450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:35.910495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.918925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.920437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:35.921563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-305ba9d3-77c2-418a-a2b4-a70401687fb0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.084635 May 26 21:21:35.922117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:35 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:36.061871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:36.062397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:36.068321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.068906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.069702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.070136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.133378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:36.140890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71a882a3-aef7-4228-aa08-fd73497e4a15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.082923 May 26 21:21:36.141473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 34/67] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:36.428759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:36.429377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:36.435661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.436108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.436899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.437337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.498658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:36.506071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:36.506597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba8ab6a0-058c-4118-9a32-dbc952ecd21d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.081585 May 26 21:21:36.506705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:36.506920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 34/68] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:36 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:36.515679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.516182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.517055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.517506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.583263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:36.591035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5a1836ba-434c-4ac3-88fd-f63bc0ecdac1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.088769 May 26 21:21:36.591615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 35/69] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:36.698235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:36.699112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:36.705469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.705919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.706680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.707625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.856403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:36.871358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-26701400-4eba-4624-bb31-81bac5b4ee0f tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.177812 May 26 21:21:36.871952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 35/70] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:36 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:36.939608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:36.940223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:36.948314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.948813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:36.949613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:36.950051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.013559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.022150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.023667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.024808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d6c2c991-b9d7-439b-bc2b-c4f83b33b2e8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.089104 May 26 21:21:37.025370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 36/71] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:36 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:37.158315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:37.158843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:37.165631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.166081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.166845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.167283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.227604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.235749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d05b74c-2c71-4a5d-ada9-259426a9ccb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.081182 May 26 21:21:37.235749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 36/72] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:37.523818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:37.524439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:37.531292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.531746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.532541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.533001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.608253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.608561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:37.609348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:37.616554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.617110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.617231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ba2f18c-7b27-4c78-85c3-2b619fb4e176 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.097754 May 26 21:21:37.617730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 37/73] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:37 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:37.617887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.618332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.681961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:37.689507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-206f91e3-a1a2-4153-aaeb-2d93f925e3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.085579 May 26 21:21:37.690088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 37/74] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:37.889354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:37.890111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:37.896685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.897137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:37.897902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:37.898336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.031770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.039992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-645a3fdc-8139-4538-9273-3e0319dd8cb6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.154697 May 26 21:21:38.046270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:38.046951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:38.050254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 38/75] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:37 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:38.055011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.055515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.056292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.056808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.122346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.130994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.132506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.133647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9e673ce7-7c9e-46de-9b58-f78f51da611d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.091672 May 26 21:21:38.134211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 38/76] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:38 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:38.251530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:38.252159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:38.258869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.259327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.260100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.260571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.489349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.496696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cdf2e3ed-8fa5-43dc-ac75-3e019583270f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.248992 May 26 21:21:38.497266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 39/77] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:38.633975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:38.634717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:38.640783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.641228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.641985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.642410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.704930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.706333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:38.707128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:38.712566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-33302751-a928-475a-b01f-9333da415ad8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.082401 May 26 21:21:38.713178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 39/78] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:38 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:38.714342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.714851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.715680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:38.716116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:38.779500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:38.787431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c4169e60-ca2e-4089-a305-74a098359602 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.085273 May 26 21:21:38.788071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 40/79] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:39.057447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:39.057979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:39.064061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.064515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.065315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.065756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.151862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:39.152719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:39.160378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.160378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.161321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.161760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.216774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.226725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fd639c28-14a6-4ee5-b540-56cd36b60e43 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.173213 May 26 21:21:39.240107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 40/80] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:39 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:39.240355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.240571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.242116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.243274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6d7c50e2-4783-43a3-bd78-cb648d9bef26 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.095502 May 26 21:21:39.243871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 41/81] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:39 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:21:39.513851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:39.514467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:39.520564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.521060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.521812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.522252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.524939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:39.588758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.596040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae5fb1e9-ec3a-44a1-84fc-79f356ec97d3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.086044 May 26 21:21:39.596624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 41/82] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:39.730024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:39.730646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:39.736813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.737271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.738041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.738991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.799572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.804266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:39.804920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:39.807840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dfe5bb4f-6960-4f2e-8529-42b9158e3f54 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.081617 May 26 21:21:39.808432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 42/83] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:39 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:39.811350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.811805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.812822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:39.813094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:39.880874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:39.889142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d0ed700e-e532-404d-92da-7ea6d9b1c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.089588 May 26 21:21:39.895620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 42/84] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:40.246304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:40.246953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:40.253549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.254743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.254858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.255257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.261685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:40.262327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:40.268806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.269254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.270685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.271120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.370595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.379822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.381379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.382492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-158fef26-b2a7-4d69-bdbb-d25e11dea1f2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.124806 May 26 21:21:40.383047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 43/85] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:40 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:21:40.432468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.434922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:40.440969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1eec3503-b52d-4bc8-907e-c1cd279a88d0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.198538 May 26 21:21:40.441582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 43/86] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:40 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:40.612986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:40.613623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:40.619772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.620222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.621028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.621466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.689826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.697831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-134dc1b3-0be9-4378-8049-1a354f8ea317 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.088576 May 26 21:21:40.698409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 44/87] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:40.824315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:40.825056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:40.831732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.832210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.833027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.833475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.899833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.907693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e8fd35af-0dba-43bb-abbc-00dd3f68a170 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.087160 May 26 21:21:40.908265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 44/88] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:40 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:40.912790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:40.913931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:40.920349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.922554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.922554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:40.922554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:40.983314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:40.991526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-608e594e-aac3-4323-85db-22e84f8a336b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.083966 May 26 21:21:40.992392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 45/89] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:41.401221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:41.401841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:41.408332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.408815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.409585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.410019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.461797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:41.462441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:41.469539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.470003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.470793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.471238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.480792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:41.490683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:41.492428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:41.493640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-86445472-c66c-4901-be4f-0cc18837a34a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.096477 May 26 21:21:41.494717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 45/90] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:41 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:41.609132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:41.617421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3a54340f-9e32-4312-ae89-abac2b912c90 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.161934 May 26 21:21:41.618004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 46/91] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:41 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:41.716781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:41.717574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:41.725468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.725984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.734638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.734638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.788141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:41.795711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-46da3567-a777-455a-a514-f29ceebebbb0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.083979 May 26 21:21:41.796299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 46/92] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:41.924086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:41.925006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:41.931913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.932367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:41.933336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:41.933781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.006053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.008097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:42.009076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:42.016440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.017004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.017848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.018371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.021141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f5f620f1-62e8-4bcc-8978-4277ba10850b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.100460 May 26 21:21:42.022624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 47/93] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:41 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:42.093726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.107806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-97266c6a-dcc0-4cdc-b7a4-c00fef809585 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.104022 May 26 21:21:42.108954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 47/94] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:42.517596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:42.520294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:42.527595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.528035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.529093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.529529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.591015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.599800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.601334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.602451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e94e22c5-fb36-4f75-981c-75fa7b3bea8f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.089462 May 26 21:21:42.603004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 48/95] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:42 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:42.633811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:42.634422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:42.640491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.640967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.641749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.642178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.721278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:42.780319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.787920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-22ba219b-08a1-4606-b6d5-4278d8784902 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.157900 May 26 21:21:42.790161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 48/96] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:42 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:42.812655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:42.813133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:42.815014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=10 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:42.820601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.821182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.821952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:42.822393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:42.885301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:42.892909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da3dcb32-7ccb-402a-ad87-250db65befd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.084187 May 26 21:21:42.893485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 49/97] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:43.038782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:43.039437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:43.045556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.046017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.046787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.047234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.110125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.118106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4c121731-1383-4e35-a33a-c5f6588d7f83 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.083200 May 26 21:21:43.118750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 49/98] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:43 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:43.131466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:43.132088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:43.138527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.138980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.139753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.140189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.206825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.214262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5c506370-9cc5-4197-a509-075eec85f13b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.088061 May 26 21:21:43.215124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 50/99] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:43.619815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:43.620425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:43.626545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.626994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.627809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.628248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.690776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.699631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.701205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.702359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4a054c9f-0617-4a13-8e17-c158e47c2e1e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.086495 May 26 21:21:43.702922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 50/100] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:43 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:43.804557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:43.805199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:43.807058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=30 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:43.812133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.812659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.813312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.813958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.910904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:43.911659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:43.917968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.918468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.919435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:43.919931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:43.946949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:43.960423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d2e3390-6222-4535-8916-ec295b5c81fe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.159686 May 26 21:21:43.961195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 51/101] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:43 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:44.001314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.009487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7db8317e-e366-445b-b190-8effc902d84d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.102530 May 26 21:21:44.010429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 51/102] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:44.135681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:44.136368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:44.142538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.142991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.143759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.144230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.210931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.218957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a94fc532-8dec-4e55-85c6-7a3b5fd1a8c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.087182 May 26 21:21:44.219534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 52/103] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:44 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:44.232115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:44.232738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:44.239534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.239976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.240899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.241332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.305723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.313765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f412eb48-bf51-4a09-8119-1d2c874df2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.086457 May 26 21:21:44.314332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 52/104] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:44.721505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:44.722287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:44.729014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.729475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.730301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.730741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.798483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.807247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.810346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:44.812177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-99a014ca-a609-49ca-93d8-e63e85de79e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1278 microversion: 2.20 time: 0.093986 May 26 21:21:44.812516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 53/105] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:44 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:21:44.980212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:44.981017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:44.984475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=28 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:44.992847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.993310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:44.994183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:44.994677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.026544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:45.027265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:45.038901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.039374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.040156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.040622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.131612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.140670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-520e41bd-a38e-40f0-bbe8-1980faf1a18f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1246 microversion: 2.1 time: 0.117884 May 26 21:21:45.148855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 54/106] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1246 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:45.205980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.214317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e69298aa-b552-44af-b99c-9053eca60c3d tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.238593 May 26 21:21:45.214884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 53/107] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:44 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:45.235199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:45.235906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:45.237721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:45.242525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.242979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.243747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.244182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.332384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:45.334155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:45.342845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.343706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.346172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.348447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.421795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.434092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0310e811-eb34-411b-a87f-e4d869438332 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1282 microversion: 2.1 time: 0.202621 May 26 21:21:45.439527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 55/108] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:45 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1282 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:45.518456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.527743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0d35544a-8573-41a0-a7bc-33750e051f0b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1241 microversion: 2.1 time: 0.199782 May 26 21:21:45.528414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 54/109] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1241 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:45.830567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:45.831262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:45.837831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.838286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.839070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:45.839509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:45.914664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.923488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.925119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:45.926311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-59b1c69d-9e4e-4b3f-bbe1-fe688c194719 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1334 microversion: 2.20 time: 0.099740 May 26 21:21:45.926883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 56/110] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:45 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1334 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:46.165703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:46.166525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:46.174388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.174842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.175700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.176208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.232979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:46.235295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:46.246729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.247512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.248674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.249547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.273683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:46.281975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3ec24d2a-8f4b-4435-8775-8c5bad6441ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1294 microversion: 2.1 time: 0.123192 May 26 21:21:46.292419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 55/111] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:46.459295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:46.460839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:46.467446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.467924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.468745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.469179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.500769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:46.503201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:46.510527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2e17030-2af5-4db0-9f00-c2e399305650 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.283201 May 26 21:21:46.511699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 57/112] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:46 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:46.549169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:46.549889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:46.559497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.560233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.561242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.562054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.710686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:46.719634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1b64e19e-6259-4db3-ad0c-6218140ce415 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1289 microversion: 2.1 time: 0.174414 May 26 21:21:46.730479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 58/113] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1289 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:46.737117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:46.745296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5b46735f-3dc5-479f-a677-f322ecf30cb0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.292435 May 26 21:21:46.745891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 56/114] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:46 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:46.950267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:46.952436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:46.963132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.967522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:46.967522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:46.967522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.301599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:47.302563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:47.326095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.329114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.336099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.339516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.390230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.400179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.403138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.404529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a548b1bd-c580-41ad-b880-ef8b0211ce47 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1342 microversion: 2.20 time: 0.462575 May 26 21:21:47.406099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 59/115] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:46 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1342 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:47.491402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-c28d5915-d125-41de-ac31-026ffaaee671 req-b2755362-923a-44e8-b4f8-fd30c5e40db3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12d905a5-35e5-4d85-9ae5-a2c6406a9256", "tag": "e328d4de-1566-4fa3-b89e-887685d736a1"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:47.500337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-c28d5915-d125-41de-ac31-026ffaaee671 req-b2755362-923a-44e8-b4f8-fd30c5e40db3 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.502845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-c28d5915-d125-41de-ac31-026ffaaee671 req-b2755362-923a-44e8-b4f8-fd30c5e40db3 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.529219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-c28d5915-d125-41de-ac31-026ffaaee671 req-b2755362-923a-44e8-b4f8-fd30c5e40db3 service nova] Creating event network-changed:e328d4de-1566-4fa3-b89e-887685d736a1 for instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 on hv-cinder-82880 May 26 21:21:47.529634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.537460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-c28d5915-d125-41de-ac31-026ffaaee671 req-b2755362-923a-44e8-b4f8-fd30c5e40db3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049813 May 26 21:21:47.538571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 60/116] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:21:47.545098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:47.547228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:47.552799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-34089cbb-88f5-464c-9118-36609f5f1e2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1302 microversion: 2.1 time: 0.256900 May 26 21:21:47.561458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.563319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.565561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.568501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.573624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 57/117] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1302 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:47.743560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:47.743560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:47.760324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.760958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.762224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.762991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.771537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.779444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a1fc4936-6027-4f61-a151-78d5e7f0b8b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.239406 May 26 21:21:47.781047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 61/118] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:47 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:47.786111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:47.786645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:47.793077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.793596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.794520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:47.795218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:47.847786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.860443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-104719cd-afce-41a2-b07f-abd089f4e7fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.126962 May 26 21:21:47.861835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 58/119] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:47.948404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:47.957708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-322e2d29-8fe1-4a85-a7a9-4054815fd96f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.174771 May 26 21:21:47.958300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 62/120] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:47 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:48.424471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:48.425089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:48.431941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.432394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.433323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.433947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.506070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.514282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.515797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.516940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96861aea-4b55-481e-b820-983a539777c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1340 microversion: 2.20 time: 0.097217 May 26 21:21:48.517503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 59/121] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:48 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:48.593581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:48.594252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:48.601276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.601729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.604080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.604080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.707938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.711396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-482760d1-a041-4b62-9da2-88d8c51c8171 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1302 microversion: 2.1 time: 0.121639 May 26 21:21:48.711978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 63/122] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1302 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:48.799783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:48.799783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:48.800443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:48.805313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.805767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.806544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.806985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.823005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:48.879213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:48.879830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:48.885843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.886340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.887072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.887503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.966706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.972954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:48.975667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-23b95780-2c34-48ca-8a35-bfe9022c22e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.100940 May 26 21:21:48.976543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 64/123] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:48.980801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c668a739-01d7-4805-a4c9-40c2358a01bb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.186628 May 26 21:21:48.990767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:48.990951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 60/124] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:48 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:48.991045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:48.991045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.991045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:48.991045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:48.991540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:49.130445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:49.138764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9547136-7a8c-4077-81e0-904518374f97 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.161031 May 26 21:21:49.139343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 65/125] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:48 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:49.541251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:49.542125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:49.549581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:49.550200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:49.552283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:49.560146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:49.638225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:49.647098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:49.648640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:49.649767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5338942e-b85a-4b71-bd4e-8903e7248aab tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1340 microversion: 2.20 time: 0.115970 May 26 21:21:49.650318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 61/126] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:49 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1340 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:49.728237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:49.728859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:49.735389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:49.735842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:49.736641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:49.737080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:49.808520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:49.811316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-487eae8e-b570-4251-9476-623997502e97 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1302 microversion: 2.1 time: 0.086935 May 26 21:21:49.811901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 66/127] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1302 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:49.994370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:49.996604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:49.998990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:49.999852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:50.005626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.007167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.008523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.008780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.009348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.009533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.010331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.010874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.101342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.108914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b6ea24e-e4db-4e05-87f0-a96b417a2d33 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.119553 May 26 21:21:50.110045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 62/128] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:50.155372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:50.155985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:50.162383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.163002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.164152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.164773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.256465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.269813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-31111582-cd15-4647-938d-2144965d1476 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.274828 May 26 21:21:50.281878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 67/129] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:49 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:50.331238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.340164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c51f7ed5-e599-4f4e-9228-b00f9f0de21b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.188771 May 26 21:21:50.340846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 63/130] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:50 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:50.667450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:50.668092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:50.674439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.674881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.675832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.676275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.746969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.754942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.756429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.757750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-81a7aafb-97a8-4792-b3ae-02be54d421bc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1340 microversion: 2.20 time: 0.094412 May 26 21:21:50.758303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 68/131] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:50 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1340 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:50.828167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:50.828808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:50.835484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.835933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.836732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:50.837170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:50.899413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:50.916191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b074d9ed-b2cd-4a35-b63b-cb336b9e9698 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1302 microversion: 2.1 time: 0.084010 May 26 21:21:50.916191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 64/132] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:51.127645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:51.128888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:51.134913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.135511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.136176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.136631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.222186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.230820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-15773879-0432-4119-8d74-a4c84386c002 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.107016 May 26 21:21:51.231510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 69/133] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:51.289357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:51.290092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:51.298115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.299276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.300066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.300964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.359917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:51.360531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:51.366997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.367438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.368628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.369915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.524571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.534296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3180fd40-6fbf-454f-86e0-cc23ac30e29e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.248956 May 26 21:21:51.546462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 65/134] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:51 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:51.639783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.650735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6ef7897e-8e0a-4089-919d-03253392fa95 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.295822 May 26 21:21:51.661967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 70/135] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:51 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:51.776433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:51.777259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:51.784994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.785470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.786232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.786672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.861908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.871221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.872962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:51.874414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-04ecf2bd-7e8c-4965-9144-2b7ee8408c88 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1340 microversion: 2.20 time: 0.102212 May 26 21:21:51.875016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 66/136] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:51 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1340 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:51.928737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:51.930127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:51.941316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.941923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:51.943186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:51.949439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.027201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:52.038148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d91ee1c1-7958-4bd5-915b-7050d5e8ae77 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1312 microversion: 2.1 time: 0.114524 May 26 21:21:52.039150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 71/137] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:52.249784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:52.250834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:52.258114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.258683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.259534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.260049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.331285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:52.341540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dddaad24-d9eb-498c-93e5-d39de2f08448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.095339 May 26 21:21:52.342466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 67/138] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:52.553021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:52.553649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:52.559836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.560377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.561068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.561502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.670546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:52.671175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:52.677532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.677992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.678777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.679223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.714999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:52.723521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-08c619ed-b4a1-4077-8ccf-71727ee09ced tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.175238 May 26 21:21:52.724135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 72/139] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:52 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:52.824664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:52.832918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37b46482-47f6-4a29-8a2e-ecd7ab55f310 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.166130 May 26 21:21:52.833511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 68/140] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:52 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:52.892364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:52.893023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:52.899984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.900481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:52.904274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:52.904274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.047084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.056756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.061528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:53.062174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:53.062426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.063532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c0632d1-fd88-4b89-93cd-3990dbf8706f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.175085 May 26 21:21:53.075327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 73/141] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:52 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:53.090898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.091296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.093075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.093523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.170057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.178292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e20645bc-0c8d-4541-a059-a23efad14a69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1312 microversion: 2.1 time: 0.126159 May 26 21:21:53.178854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 69/142] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1312 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:53.359600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:53.360132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:53.366989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.367438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.368206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.368697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.433900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.441658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7abf48e4-a738-426d-9955-e16cd1059b20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.085954 May 26 21:21:53.442253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 74/143] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:53.743949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:53.744804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:53.755013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.755466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.756432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.757066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.762021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:53.799905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-7b742ff9-e170-4ac6-9d00-edc59c3f5d44 req-1f626262-29c4-4a06-9e11-aded58c9a796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3546719-ea65-4d99-bb86-ae1d6c62a867", "name": "network-vif-plugged", "status": "completed", "tag": "a6173aff-5c1e-4cda-b784-150fc80aa28a"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:53.809106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-7b742ff9-e170-4ac6-9d00-edc59c3f5d44 req-1f626262-29c4-4a06-9e11-aded58c9a796 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.809542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-7b742ff9-e170-4ac6-9d00-edc59c3f5d44 req-1f626262-29c4-4a06-9e11-aded58c9a796 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.822915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-7b742ff9-e170-4ac6-9d00-edc59c3f5d44 req-1f626262-29c4-4a06-9e11-aded58c9a796 service nova] Creating event network-vif-plugged:a6173aff-5c1e-4cda-b784-150fc80aa28a for instance d3546719-ea65-4d99-bb86-ae1d6c62a867 on hv-cinder-82880 May 26 21:21:53.831006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-7b742ff9-e170-4ac6-9d00-edc59c3f5d44 req-1f626262-29c4-4a06-9e11-aded58c9a796 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107291 May 26 21:21:53.832420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 70/144] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:53.851725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:53.852469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:53.869657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.870274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.872997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:53.874538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:53.925017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:53.934310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ab932738-499e-4a3b-96f1-0fc42d967bce tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.196866 May 26 21:21:53.934908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 75/145] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:53 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:54.035821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.044164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4e535fb1-ce12-40d2-a113-d4291706fd1c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.197461 May 26 21:21:54.044839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 71/146] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:53 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:54.083153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:54.083757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:54.089793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.090233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.090980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.091414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.197700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:54.198923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:54.207907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.208363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.209844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.210676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.251022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.260379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.262068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.263181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3637a97-5f9c-4c4d-a8c0-4094059919bb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.184671 May 26 21:21:54.263741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 76/147] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:54 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:54.280474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.288057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5eb874cb-6a02-4271-9175-293899e80d32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1312 microversion: 2.1 time: 0.095822 May 26 21:21:54.288649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 72/148] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:54.459630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:54.460315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:54.467080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.467583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.468359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.468821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.569190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:54.577639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b6b33d24-9831-4961-86b6-1b8ae511d014 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1297 microversion: 2.1 time: 0.122616 May 26 21:21:54.580801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 77/149] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:54.952240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:54.952931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:54.959640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.960115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:54.960938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:54.961570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.068242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:55.068945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:55.075967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.080756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.080756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.080756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.470122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:55.484263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8879a558-d443-4604-9840-6388c0af4a22 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.535857 May 26 21:21:55.485754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 73/150] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:54 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:55.492339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:55.493408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:55.502242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.502769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.504055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.504667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.560239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:55.569543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-036003fe-01cb-4ae1-a7eb-2569ec613a93 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.511944 May 26 21:21:55.570228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 78/151] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:55 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:55.585170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:55.585863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:55.600678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.601150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.603744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.604198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.920284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:55.929970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ac64aa5e-a7c1-45b1-aa9a-a60770ef3f1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1300 microversion: 2.1 time: 0.358453 May 26 21:21:55.930872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 79/152] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1300 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:55.937335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:55.938483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:55.957873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.958329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:55.959100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:55.959537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:56.103620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:56.112552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-87cbe59c-f504-4c9e-a1e4-0a32df9fa8ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1295 microversion: 2.1 time: 0.180461 May 26 21:21:56.113448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 80/153] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1295 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:56.214860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:56.224048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:56.225636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:56.226762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1aab89a5-d544-404e-8102-ebd6cb33e0d2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.739706 May 26 21:21:56.227412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 74/154] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:55 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:56.503125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:56.503867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:56.511144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:56.511673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:56.513426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:56.514047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:56.589101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:56.589705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:56.600715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:56.601166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:56.602151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:56.602623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.054028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.062479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbd315ca-7be9-4e2d-9c74-693ed9bffcbb tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.563992 May 26 21:21:57.063942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 81/155] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:56 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:57.069964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:57.071224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:57.075919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.080522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.081196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.082655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.083195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.090620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-da23f1bf-f670-49b7-a4d2-c1c11dcc5166 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.506242 May 26 21:21:57.090620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 75/156] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:56 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:57.130449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:57.130650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:57.138429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.138950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.139643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.141224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.203505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.225182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-27f35109-e2c4-4750-aeec-c28a87f59cde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1300 microversion: 2.1 time: 0.159739 May 26 21:21:57.225685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 82/157] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1300 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:57.245902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:57.246943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:57.272868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.273532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.275051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.277634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.545026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.548980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8b5741a0-7ce6-4c9c-be6b-e9b0747e2360 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.423129 May 26 21:21:57.549853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 76/158] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:57.570032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-8d6b39f5-0f7e-4ef5-9f64-f101716866e5 req-ebff66d1-3bc6-4040-be6f-0ec524b0cdb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:21:57.590316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-8d6b39f5-0f7e-4ef5-9f64-f101716866e5 req-ebff66d1-3bc6-4040-be6f-0ec524b0cdb6 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:57.591075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-8d6b39f5-0f7e-4ef5-9f64-f101716866e5 req-ebff66d1-3bc6-4040-be6f-0ec524b0cdb6 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:57.608555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.612448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-8d6b39f5-0f7e-4ef5-9f64-f101716866e5 req-ebff66d1-3bc6-4040-be6f-0ec524b0cdb6 service nova] Creating event network-changed:f05cef3c-e3f9-4f57-80cb-753ef76b7536 for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 on hv-cinder-82880 May 26 21:21:57.617808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.618130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-8d6b39f5-0f7e-4ef5-9f64-f101716866e5 req-ebff66d1-3bc6-4040-be6f-0ec524b0cdb6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055652 May 26 21:21:57.618814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 77/159] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:21:57.619628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:57.621028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da82cd3c-bf33-41f2-ad87-fd1020235dbd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.379991 May 26 21:21:57.621792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 83/160] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:57 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:21:58.081199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:58.081845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:58.088175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.088644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.089406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.089871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.105772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:21:58.114088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:58.114088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:58.116923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.117388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.118191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.118610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.293821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.300847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.302165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8bb3e73e-e7f9-4a74-b6a9-995206b30b14 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.224726 May 26 21:21:58.302574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 78/161] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:58 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:58.307219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:58.307834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:58.308437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aaff4bb3-5f15-440d-b440-59f9413a29c3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.204436 May 26 21:21:58.309075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 84/162] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:58 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:58.318039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.318039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.318039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.318039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.449957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.458651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b712be46-6d02-432a-a34b-bc611bc9478a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.154808 May 26 21:21:58.459206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 79/163] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:58.567951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:58.568556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:58.574686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.575131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.575887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.576312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.639333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:58.639987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:58.646615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.647086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.647858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:58.648291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:58.743161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.750554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c6489c38-1758-4833-bcb1-1cdd4bf090c5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.186959 May 26 21:21:58.751130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 85/164] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:58.811908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.820441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.821989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:58.823122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-873642a5-0f15-4d32-bf8f-ef5ed85bf1de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.187858 May 26 21:21:58.823682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 80/165] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:58 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:21:59.318908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:59.319443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:59.325569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:59.327138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.327276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:59.327411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.327411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.327625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.332542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.333060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.333835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.334269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.542466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:59.545504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:59.550283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-88b88cdf-7e76-4da9-a965-7719ffea0551 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.228513 May 26 21:21:59.551400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 81/166] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:59 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:21:59.554790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4a109c43-6d34-4487-81cc-bc9edea562d7 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.238879 May 26 21:21:59.554790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 86/167] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:59 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:59.562967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:59.563601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:59.569661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.570046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.570804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.571241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.724177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:59.732024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-49c72fa7-2385-4f00-9cdc-e396f1d98f1d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.179417 May 26 21:21:59.732762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 82/168] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:21:59.767302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:59.767923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:59.774450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.774906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.775674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.776114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.841842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:21:59.842484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:21:59.857930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.858409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.864986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:21:59.864986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:21:59.927321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:21:59.936398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b9b1e630-ff3d-43b6-ace7-3df3108e81ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.172789 May 26 21:21:59.937043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 87/169] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:21:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:00.139752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.149165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.150754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.151978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a605288-891d-405d-b7bc-0f89f68ddd4b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.314225 May 26 21:22:00.153149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 83/170] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:21:59 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:22:00.568057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:00.568703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:00.569629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:00.570264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:00.574965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.575418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.576195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.576313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.576657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.576749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.577428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.577862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.777557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.781176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.785399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ea1c880-ec4d-424f-a060-f514a4d4e6bd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.221210 May 26 21:22:00.785981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 88/171] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:00 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:00.788610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0ff7eb11-4c22-42ee-b3d5-f9ccf5030d0e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.222757 May 26 21:22:00.789459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 84/172] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:00 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:00.790621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:00.791235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:00.797266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.797712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.798467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.798896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.931855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:00.939366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bd832b23-cf0d-4771-8106-a12ce1678c3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.152431 May 26 21:22:00.939935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 89/173] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:00.953744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:00.954355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:00.961161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.961605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:00.962367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:00.962796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.093971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:01.101750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3db0645f-3975-48f2-b814-d25ac6cc977e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.151983 May 26 21:22:01.102342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:01.171323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:01.171930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:01.178614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.179064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.179823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.180268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.314632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:01.323251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:01.324783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:01.325874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-300e72e4-b82b-4d31-8845-c960ebb958af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.158434 May 26 21:22:01.326433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 90/175] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:01 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:01.802754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:01.803503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:01.806484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:01.807165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:01.809704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.810219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.811018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.811457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.813513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.814028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:01.814744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:01.815186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.012241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.019381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.019984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5570037b-804b-45c9-a40c-9788f3cdfd66 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.221609 May 26 21:22:02.020599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 86/176] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:01 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:02.022073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:02.025758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:02.026381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:02.033997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-15a6fd57-8a78-4d4a-84c3-5b83fed561c3 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.227184 May 26 21:22:02.033997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 91/177] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:01 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:02.034204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.034204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.034204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.034461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.119406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:02.120200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:02.129732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.130339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.131342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.132029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.205510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.213270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d4bb181-3397-40c8-baf6-6dbd1438ca58 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.191650 May 26 21:22:02.213859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 87/178] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:02.274647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.282567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2d4526e-82a5-4ec0-b902-6eb4dd52256e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.167104 May 26 21:22:02.283389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 92/179] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:02.344000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:02.344606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:02.351416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.351869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.352726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:02.353168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:02.563173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.563173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.563415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:02.563415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aa6b7d91-6dd5-4a89-aa57-fe6ffef69988 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.158321 May 26 21:22:02.563415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 88/180] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:02 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:03.037237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:03.037842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:03.044493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.044970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.045745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.046182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.049224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:03.049850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:03.056068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.056525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.057495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.057777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.242148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.246439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.249922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ef71ad14-a521-4e6d-a4bf-66b8a39366f9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.216618 May 26 21:22:03.250578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 93/181] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:03 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:03.254628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d05c1abc-55ab-4b3b-83d4-9625631c7308 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.209224 May 26 21:22:03.255339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 89/182] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:03 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:03.255533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:03.256093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:03.262029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.262479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.263233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.263663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.299836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:03.300692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:03.306985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.307437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.308216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.308704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.448677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.456212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e66472f5-70c6-49e5-9d61-3cf9134738ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.204643 May 26 21:22:03.457380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 94/183] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:03.477245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.484654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eb668e37-3e8e-4a6a-aa03-fdc529d5445b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.188620 May 26 21:22:03.485213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 90/184] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:03.515854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:03.516386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:03.522930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.523377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.524134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:03.524570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:03.663154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.671407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.672982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:03.674122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-448ba914-3d00-423e-b3c0-c9a729fd5e6a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.162202 May 26 21:22:03.674690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 95/185] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:03 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:04.267372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:04.268321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:04.271359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:04.271976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:04.275169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.275806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.276815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.277495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.278085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.278803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.280487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.280487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.896544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:04.904682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61f2af55-ae59-4c92-b0ca-f96438820680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.641233 May 26 21:22:04.905271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 91/186] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:04 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:04.909894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:04.910516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:04.917003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.917458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.918238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.918662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.921492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:04.930389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0250bec5-eb8e-43f1-a62a-658fc2395676 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.662574 May 26 21:22:04.932179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 96/187] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:04 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:04.936793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:04.937818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:04.945904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.946637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:04.947410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:04.948311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.255042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:05.259393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:05.262974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a31ff14e-8486-41cc-abdd-347fb0d0df41 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.356669 May 26 21:22:05.266266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 92/188] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:05.268876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:05.270497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:05.277174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2c8f31bf-fd2a-4932-b8ec-3704fb873d82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.344675 May 26 21:22:05.277781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.277991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.279340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.279532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 97/189] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:05.280232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.608918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:05.623046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:05.624891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:05.626454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-19a6b97c-5fc6-4177-acd3-8b50f22168ed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.361645 May 26 21:22:05.627248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 93/190] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:05 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:05.855744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-d85fc80f-ce8b-4e9c-9214-cc8c7c0e5587 req-d72cadd4-e207-4002-b429-756f415b4e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3748fe34-6403-4819-a21a-19fd842440b9", "tag": "8bf7c6f2-a31b-4347-a5f9-b986a9a803c3"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:05.865942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d85fc80f-ce8b-4e9c-9214-cc8c7c0e5587 req-d72cadd4-e207-4002-b429-756f415b4e67 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.866534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d85fc80f-ce8b-4e9c-9214-cc8c7c0e5587 req-d72cadd4-e207-4002-b429-756f415b4e67 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.879875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-d85fc80f-ce8b-4e9c-9214-cc8c7c0e5587 req-d72cadd4-e207-4002-b429-756f415b4e67 service nova] Creating event network-changed:8bf7c6f2-a31b-4347-a5f9-b986a9a803c3 for instance 3748fe34-6403-4819-a21a-19fd842440b9 on hv-cinder-82880 May 26 21:22:05.886578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-d85fc80f-ce8b-4e9c-9214-cc8c7c0e5587 req-d72cadd4-e207-4002-b429-756f415b4e67 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034677 May 26 21:22:05.890726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 98/191] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:05.921927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:05.922471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:05.929805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.930236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.931212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.931828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.954791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:05.955506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:05.962253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.962999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:05.964257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:05.964757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.145384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.153017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c630b505-85e9-43c6-a724-02b5836399e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.235341 May 26 21:22:06.153857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 94/192] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:05 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:06.175309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.185397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61422f50-44ed-4ebd-aa64-583e7d6b4829 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.240775 May 26 21:22:06.188753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 99/193] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:05 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:06.283674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:06.284292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:06.290425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.290885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.291648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.292090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.294959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:06.299256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:06.299955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:06.306272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.306584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.307358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.307799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.433405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.443133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-62695a40-9c67-450b-af79-0d858381930c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.163283 May 26 21:22:06.444062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 95/194] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:06.580522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.588744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9cd8bc1c-3cde-4fda-99b7-b65d94dd5ca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.293396 May 26 21:22:06.589311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 100/195] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:06.646027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:06.646733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:06.652849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.653300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.654326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:06.654765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:06.786096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.794155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.795670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:06.796802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-44a8813d-fd18-47e6-8b1d-f0a5f41928c6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.155350 May 26 21:22:06.797353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 96/196] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:07.170652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:07.171302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:07.177379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.177834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.178599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.179043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.202788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:07.203470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:07.211215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.211804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.212757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.213290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.367801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.375263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eaf050d2-2e65-4f51-8d1b-d28a23cacbdc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.208476 May 26 21:22:07.375861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 101/197] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:07 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:07.390102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.397692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-228bdc5e-23d3-4a98-85df-21949594ef00 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.198719 May 26 21:22:07.398274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 97/198] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:07 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:07.460550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:07.461181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:07.467250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.467699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.468442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.468910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.605523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:07.612771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:07.613487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.613611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.613611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.614288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.614727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.614970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a562af4e-ed02-4afa-916d-1da232f75bc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.158679 May 26 21:22:07.615557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 102/199] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:07.749987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.757959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-30cd56b9-773f-4a91-a614-f43d2c1f0767 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.156409 May 26 21:22:07.758528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 98/200] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:07.815318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:07.816500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:07.822632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.823084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.823852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.824290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.907214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-3c07ca92-a824-471d-9c03-43e1ea398618 req-ad44ab92-b15e-49fa-a8c3-002d4e97a3c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a593d7f5-c378-4a24-a59d-53fcf2e6ffcc", "tag": "2c2d13db-51bd-48b0-b8f7-bb7290971377"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:07.915533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3c07ca92-a824-471d-9c03-43e1ea398618 req-ad44ab92-b15e-49fa-a8c3-002d4e97a3c8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:07.915975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3c07ca92-a824-471d-9c03-43e1ea398618 req-ad44ab92-b15e-49fa-a8c3-002d4e97a3c8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:07.932297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-3c07ca92-a824-471d-9c03-43e1ea398618 req-ad44ab92-b15e-49fa-a8c3-002d4e97a3c8 service nova] Creating event network-changed:2c2d13db-51bd-48b0-b8f7-bb7290971377 for instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc on hv-cinder-82880 May 26 21:22:07.937753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-3c07ca92-a824-471d-9c03-43e1ea398618 req-ad44ab92-b15e-49fa-a8c3-002d4e97a3c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035386 May 26 21:22:07.939550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 99/201] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:22:07.967661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.976331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.977894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:07.979031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c1ece974-b5a4-4cf7-922b-cfe49cc7233e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.167636 May 26 21:22:07.979603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 103/202] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:07 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:08.393019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:08.393747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:08.399988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.400443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.401244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.401716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.415593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:08.416216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:08.422158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.422609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.423383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.423824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.605070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:08.609440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:08.612659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b800a45d-3ad9-4d7a-a409-776b36e12305 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.223813 May 26 21:22:08.613739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 100/203] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:08 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:08.618612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4f7ab61d-1772-4e21-a033-e0ea018fbb84 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.207011 May 26 21:22:08.619500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 104/204] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:08 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:08.631712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:08.632319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:08.638359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.638806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.639556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.639987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.775210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:08.775519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:08.776145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:08.782783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:08.783728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6e255990-1330-46e1-b5be-60fdbf2d4d37 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.156364 May 26 21:22:08.784264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.788926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 101/205] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:08.789085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.789085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:08.789085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:08.915645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:08.922728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-18405681-2732-4842-9c51-667a495f9817 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.150998 May 26 21:22:08.923325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 105/206] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:08.997856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:08.999872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:09.005153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.005603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.006376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.006814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:09.142162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:09.143668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:09.145422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-898ff4ee-a7ae-4d23-b489-ec8df751f850 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.151674 May 26 21:22:09.145972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 102/207] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:08 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:09.630789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:09.631420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:09.634907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:09.635570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:09.637718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.638173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.643115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.643115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.643289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.643289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.643289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.643289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.842856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:09.845611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:09.850963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4b14658-2307-45d0-bc91-3a9fa063d3dc tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.219681 May 26 21:22:09.852247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 103/208] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:09 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:09.853361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ad517b1-5666-4551-83c2-78715ad3f1a4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.226497 May 26 21:22:09.853933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 106/209] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:09 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:09.860925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:09.860925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:09.864228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.864709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.865483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.865925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.939365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:09.939971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:09.946131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.946576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:09.947344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:09.947773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.032113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:10.049336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-345868a3-6e5f-4e7b-9602-f002693f67c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.187365 May 26 21:22:10.049336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 104/210] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:10.094251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:10.102209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-54642d52-0e61-4f9d-9987-b63da575f1a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.166753 May 26 21:22:10.102779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 107/211] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:10.164055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:10.164817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:10.170762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.171204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.171954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.172387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.302141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:10.310076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:10.311610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:10.312764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-49646d92-0336-4914-8a62-3980aec6bc80 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.153127 May 26 21:22:10.313329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 105/212] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:10 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:10.867363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:10.867999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:10.872880 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:10.873579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:10.874898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.875351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.876492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.876628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.880095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.880537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:10.881325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:10.881755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.085510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.092852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.093609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-38e5f81f-af35-4031-8484-db4592caa37e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.230177 May 26 21:22:11.094194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 108/213] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:10 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:11.102795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:11.102795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:11.103016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e7940b4a-390e-43df-ba07-9dacd6a77302 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.233014 May 26 21:22:11.103016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 106/214] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:10 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:11.105250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.105705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.106475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.106921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.110855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:11.118760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:11.119358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:11.125670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.126325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.127208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.127699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.302362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.309398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.309755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c6fc66c7-6edc-4caa-a43c-b6115c14da9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.214586 May 26 21:22:11.310551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 109/215] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:11.317416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b6364ebd-bbc0-4d69-af1f-9887cfd88869 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.202451 May 26 21:22:11.317983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 107/216] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:11.330340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:11.330979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:11.337566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.338493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.338771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:11.339208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:11.466482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.474726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.476206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:11.477332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3c6e4141-57b8-4256-b2d8-17453d90fe14 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.150818 May 26 21:22:11.477888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 110/217] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:11 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:12.112236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:12.118113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:12.119363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:12.120137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:12.128262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.129410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.132739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.133181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.133960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.134394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.139906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.140624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.356321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.359564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.364037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-492a10bf-0c3b-4bd3-a451-428b53e26592 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.249805 May 26 21:22:12.364751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 111/218] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:12 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:12.367277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7c95654f-0c0c-4d05-826a-442a1acf26d8 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.259857 May 26 21:22:12.367839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 108/219] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:12 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:12.372501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:12.373141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:12.378007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-fe2a8c81-d179-46be-bc2a-8cbd826d083b req-7ee18336-983c-44f6-8783-f68aaa537051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3", "name": "network-vif-plugged", "status": "completed", "tag": "d5a7772c-a49f-4686-b4ba-78b4ac8f17bf"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:12.379726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.380172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.380960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.381398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.386840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-fe2a8c81-d179-46be-bc2a-8cbd826d083b req-7ee18336-983c-44f6-8783-f68aaa537051 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.387363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-fe2a8c81-d179-46be-bc2a-8cbd826d083b req-7ee18336-983c-44f6-8783-f68aaa537051 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.399050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-fe2a8c81-d179-46be-bc2a-8cbd826d083b req-7ee18336-983c-44f6-8783-f68aaa537051 service nova] Creating event network-vif-plugged:d5a7772c-a49f-4686-b4ba-78b4ac8f17bf for instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 on hv-cinder-82880 May 26 21:22:12.404375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-fe2a8c81-d179-46be-bc2a-8cbd826d083b req-7ee18336-983c-44f6-8783-f68aaa537051 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029564 May 26 21:22:12.405093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 112/220] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:12.410537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:12.411343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:12.417736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.418159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.418995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.419507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.564433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.571856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6220d375-7363-4b8e-938d-1601d4d10a20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.203044 May 26 21:22:12.573284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 109/221] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:12.578155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:12.578952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:12.584367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:12.586500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.586951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.587731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:12.588171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:12.593815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.601644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8122c79c-ff15-4dcd-a79f-26bfd271a3a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.195287 May 26 21:22:12.602213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 113/222] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:12.719293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.728345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.729930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:12.731091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-629881db-0889-46f4-b200-0b6cbf548774 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.157344 May 26 21:22:12.731647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 110/223] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:12 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:13.382006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:13.383285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:13.389170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:13.390142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:13.391357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.391811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.392827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.393592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.397659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.398457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.399464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.400119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.603289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:13.607976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:13.615982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70d02d74-d4bf-4206-8896-b29adf3f35c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.238149 May 26 21:22:13.617002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 114/224] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:13 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:13.622062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:13.622666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:13.626141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-82b6b4c3-c055-4475-859d-1371a912f8b6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1315 microversion: 2.1 time: 0.245779 May 26 21:22:13.627018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 111/225] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:13 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:13.629980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.630432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.631217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.631662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.641357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:13.641912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:13.648695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.649370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.650166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.650599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.666847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:13.840433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:13.845109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:13.849110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0b11418-752b-48c1-8b4e-e0c3db94bc0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.230806 May 26 21:22:13.850052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 115/226] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:13.852992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-939f02e2-71dc-4634-9254-654234f90f22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.215353 May 26 21:22:13.853628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 112/227] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:13.863063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:13.863701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:13.869820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.870268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:13.871072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:13.871503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:14.006575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:14.014770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:14.016374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:14.017516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e06d6307-2deb-46cd-a59b-d7b05ab1820e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.166758 May 26 21:22:14.018082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 116/228] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:13 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:14.633782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:14.636450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:14.640554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:14.641040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:14.641815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:14.642253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:14.643341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:14.643994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:14.652225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:14.652793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:14.653573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:14.667137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.349311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.352389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.357719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-005786ec-8c15-48c5-8bfc-5b9cf1a3e7c0 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1502 microversion: 2.1 time: 0.718205 May 26 21:22:15.358305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 117/229] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:14 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1502 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:15.361167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f993f0d8-29c2-475d-9356-b88274b33349 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.731243 May 26 21:22:15.362166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 113/230] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:14 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:15.367222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:15.368020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:15.373640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:15.374277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:15.374494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.375219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.375921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.376345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.382473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.382473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.382634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.383030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.760909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.770222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-246731a7-7580-434b-b7d9-1be4f12a50bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.405634 May 26 21:22:15.770430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 114/231] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:15.775271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:15.775900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:15.779855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.782539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.782992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.783772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:15.784212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:15.795070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-66e281d5-d0f3-4d2c-99ac-e545afa1c496 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.424767 May 26 21:22:15.796872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 118/232] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:15.938518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.948369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.950652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:15.951526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-60b7ceb7-b312-44d0-8894-0caa4b130d67 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.179934 May 26 21:22:15.952111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 115/233] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:15 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:16.379860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:16.380934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:16.396624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.406787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:16.410323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.410323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:16.792863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:16.793901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:16.802014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.802598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:16.803627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.804159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:16.844949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:16.854940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1c2a2c30-31f2-44f9-a2f9-915e06fe40d2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.480553 May 26 21:22:16.856689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 119/234] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:16 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:16.864061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:16.864712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:16.871501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.872015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:16.872961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:16.873525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:17.101620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:17.105325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:17.121370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-14423d8c-cc84-4740-86c0-ac45ef117802 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.336548 May 26 21:22:17.144519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-468d4346-8f2f-4c68-8a3a-25d222c0f7f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.267162 May 26 21:22:17.145197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 120/235] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:17.145623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 116/236] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:17.150692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:17.151496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:17.160163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:17.160765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:17.161790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:17.162570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:17.357062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:17.368027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:17.369703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:17.371361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33a8271d-aa6b-42b2-9a5c-fcd94bffeb04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.224529 May 26 21:22:17.371961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 117/237] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:17 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:17.871253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:17.872031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:17.882430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:17.882885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:17.884422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:17.885055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.070824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.079312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a63183ca-e947-4c23-aecf-32a5e7b2282c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.211827 May 26 21:22:18.080285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 121/238] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:17 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:18.142593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:18.143270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:18.149546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.150000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.150772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.151212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.161124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:18.161744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:18.178882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.179332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.180111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.180548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.368049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.375842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9cb0c8e3-7d64-4576-a191-c6a89c112cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.237409 May 26 21:22:18.376432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 118/239] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:18.385250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a269171b-b399-4a3d-a8c2-e362bb3cfffb"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:18.387278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:18.390230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.393731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.394799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.395773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.398060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.398592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-411ceb45-c2cb-47a9-842b-9b1e35d4f942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.241906 May 26 21:22:18.399331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 122/240] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:18.404149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:18.405656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:18.411953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.412596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.413359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.413791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.582297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.591698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.593608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:18.594713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4942fd2f-1b98-484b-bf62-dea0611b48b4 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.194337 May 26 21:22:18.595369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 123/241] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:18 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:18.813226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-4c142b2d-0407-4763-8912-2af2a15a6211 req-5914849a-b607-486a-8ac0-94d6a72d4454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d905a5-35e5-4d85-9ae5-a2c6406a9256", "name": "network-vif-plugged", "status": "completed", "tag": "e328d4de-1566-4fa3-b89e-887685d736a1"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:18.822281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-4c142b2d-0407-4763-8912-2af2a15a6211 req-5914849a-b607-486a-8ac0-94d6a72d4454 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:18.823219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-4c142b2d-0407-4763-8912-2af2a15a6211 req-5914849a-b607-486a-8ac0-94d6a72d4454 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:18.836599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-4c142b2d-0407-4763-8912-2af2a15a6211 req-5914849a-b607-486a-8ac0-94d6a72d4454 service nova] Creating event network-vif-plugged:e328d4de-1566-4fa3-b89e-887685d736a1 for instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 on hv-cinder-82880 May 26 21:22:18.842815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-4c142b2d-0407-4763-8912-2af2a15a6211 req-5914849a-b607-486a-8ac0-94d6a72d4454 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 May 26 21:22:18.843419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 124/242] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:22:19.102418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:19.102418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:19.108795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.109245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.110002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.110437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.261164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.268684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1135edb9-1763-4099-aa58-2f6107fd6b64 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.173570 May 26 21:22:19.270068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 125/243] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:19 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:19.401072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:19.401701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:19.407948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.408403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.410217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.410217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.583762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.593163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4192fb75-22bc-4811-a2cf-0d7afabc2c32 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.198563 May 26 21:22:19.593730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 126/244] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:19.599120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:19.599928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:19.606340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.607092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.608449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.609236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.632081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:19.754737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.767014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3827702e-ad33-4dd7-b5a5-c339632dc713 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.170461 May 26 21:22:19.768000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 127/245] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:19.773751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:19.774370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:19.781461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.781781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.782553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:19.783201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:19.919468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.931379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.933040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:19.934306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f072f0a3-1acf-41dc-81d3-32cddd1265db tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.165030 May 26 21:22:19.934864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 128/246] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:19 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:20.287010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:20.287936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:20.294516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.294973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.295753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.296198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.450326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:20.459736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95a7bf26-d29d-4f9d-9259-1a70622de496 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.177214 May 26 21:22:20.460314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 129/247] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:20 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:20.612796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:20.615293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:20.625856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.626383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.627208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.627607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.780155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:20.788599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-049a8a4c-729f-4da1-a20c-5c2687799804 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.181304 May 26 21:22:20.789186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 130/248] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:20.793617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:20.794226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:20.800240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.800738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.801499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.801937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.961892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:20.970802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-40ed6933-ce2d-4f42-b73a-ab857b790551 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.180117 May 26 21:22:20.971398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 131/249] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:20.977132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:20.977938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:20.990024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.990474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:20.991783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:20.992260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:21.142499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:21.153214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:21.155381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:21.158150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e29045aa-8901-4bbf-b162-6fb94f5087bf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.184006 May 26 21:22:21.158150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 132/250] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:20 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:21.478240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:21.479024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:21.485754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:21.486302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:21.487163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:21.487744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:21.955099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:21.963407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e0920a9a-f61a-4f87-b1ff-666801b5f142 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.489450 May 26 21:22:21.964096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 133/251] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:21 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:21.968744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:21.972959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:21.976109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:21.976563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:21.977367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:21.977801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:22.116432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:22.123905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f422925f-a839-421f-acea-48f153cd6442 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.158744 May 26 21:22:22.124486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 134/252] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:22.129167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:22.129776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:22.135707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:22.136193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:22.137005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:22.137510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:22.149420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ce42c1b1-2e3f-43c7-b662-58161641f094 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "POST /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.771753 May 26 21:22:22.151805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 119/253] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:22:18 2022] POST /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867/os-volume_attachments => generated 194 bytes in 3775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:22.175514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:22.176448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:22.190044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:22.190523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:22.191312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:22.191755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:22.312549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:22.326223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ebac3fa9-fa8d-4f6d-b2da-09e6f8f0be78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.200656 May 26 21:22:22.327628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 135/254] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:22.383213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:22.391216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:22.392760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:22.394043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6cb948c4-a32b-4d13-8646-6b582dea6728 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.222790 May 26 21:22:22.395137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 120/255] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:22 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:22.987294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:22.988714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:23.004435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.004435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.004435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.004435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.138699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.141024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:23.141641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:23.146394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-79a59130-9bbc-4b5a-b133-1546b58f2c02 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.162909 May 26 21:22:23.147000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 136/256] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:22 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:23.148608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.149145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.150454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.151007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.287565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.295249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f330e6d5-eb0c-49e6-ad82-318658741cf3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.158488 May 26 21:22:23.295844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 121/257] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:23.343375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:23.344433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:23.351524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.352732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.352871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.353303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.412468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:23.413182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:23.431193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.431843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.433127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:23.434325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:23.578527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.591677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4a04a1a0-8e01-454a-86bb-f88c81f409ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.252252 May 26 21:22:23.592549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 137/258] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:23.638247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.646873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.648385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:23.649507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c106ddb0-4c33-431f-bf32-b78c21f0c503 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.241666 May 26 21:22:23.650072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 122/259] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:24.163340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:24.163876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:24.169998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.175704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.175704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.175704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.310901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.313836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:24.314606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:24.321093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-deb599ac-e15f-4e7f-b44b-e4e332b2dcc2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.161545 May 26 21:22:24.322102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 138/260] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:24 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:24.334455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.334947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.335764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.336346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.483797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.493363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d5816e5-19b6-4340-babf-fed87289b78c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.183968 May 26 21:22:24.494281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 123/261] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:24.609894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:24.610741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:24.622434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.622962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.623951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.624392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.679180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:24.679180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:24.684080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.684652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.685504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.686044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.830947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.839576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1f844fd7-0999-4ea2-a423-55f34022bc11 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.234001 May 26 21:22:24.840522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 139/262] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:24.862971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.871453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.873331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:24.874582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-12899940-dbe1-4e5f-8cf2-a7e564d26033 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.210135 May 26 21:22:24.875295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 124/263] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:22:24.901475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-72fd24e7-d149-4ad1-b067-864e120c5d4c req-d0c90e6b-30de-4eef-9fd9-8b6f0aaf4e05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "name": "network-vif-plugged", "status": "completed", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:24.910676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-72fd24e7-d149-4ad1-b067-864e120c5d4c req-d0c90e6b-30de-4eef-9fd9-8b6f0aaf4e05 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:24.911129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-72fd24e7-d149-4ad1-b067-864e120c5d4c req-d0c90e6b-30de-4eef-9fd9-8b6f0aaf4e05 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:24.922295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-72fd24e7-d149-4ad1-b067-864e120c5d4c req-d0c90e6b-30de-4eef-9fd9-8b6f0aaf4e05 service nova] Creating event network-vif-plugged:f05cef3c-e3f9-4f57-80cb-753ef76b7536 for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 on hv-cinder-82880 May 26 21:22:24.927890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-72fd24e7-d149-4ad1-b067-864e120c5d4c req-d0c90e6b-30de-4eef-9fd9-8b6f0aaf4e05 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 May 26 21:22:24.928518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 140/264] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:25.338888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:25.340328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:25.348334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.349058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.350041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.350943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.512329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:25.513654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:25.521436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.524718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.524718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.524718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.591813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:25.604285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a9dfb52-a0f8-44af-a52e-17d741014cff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.268725 May 26 21:22:25.605581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 125/265] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:25 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:25.764385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:25.772377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e8fd958a-4421-4e38-a4f9-e009fb6a5c12 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.264306 May 26 21:22:25.773038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 141/266] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:25.857272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:25.857933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:25.864958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.865424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.866630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.866630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.899604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:25.901230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:25.909591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.911448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:25.915635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:25.927620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:26.082708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:26.091485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f07e02db-810e-482f-9866-88628cb67e69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.238005 May 26 21:22:26.092218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 126/267] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:26.120783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:26.133038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:26.134556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:26.135970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8996aaea-f6b0-4ce9-b28f-3d6af3ebcb16 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.245488 May 26 21:22:26.136808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 142/268] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:25 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:26.623672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:26.624716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:26.636098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:26.637898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:26.638297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:26.639108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:26.792364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:26.793369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:26.805945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:26.808362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:26.809327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:26.811679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:26.966218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:26.974648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:26.979783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-727284ad-d003-436d-9708-a24b4ef8815e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1322 microversion: 2.1 time: 0.360551 May 26 21:22:26.980605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 127/269] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:26 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:27.053516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:27.061998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-29fc2ed0-2f32-4eb4-bf69-7a1791ea729a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.275667 May 26 21:22:27.065988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 143/270] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:27.109699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:27.110630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:27.120342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:27.120928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:27.122165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:27.123234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:27.158531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:27.160089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:27.168794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:27.170780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:27.171615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:27.172059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:27.193886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:27.440044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:27.448476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:27.460216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d03f60a4-50d4-414a-8a26-dd540bbdba1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.354655 May 26 21:22:27.461142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 128/271] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:27.461810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:27.463490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:27.464652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-517788bc-dedb-451f-8fa8-f167efd54bba tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.313184 May 26 21:22:27.465470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 144/272] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:27 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:22:27.998024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:27.998709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.006084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.006545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.007323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.007768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.085438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:28.086733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.095278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.096572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.098402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.099084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.168103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:28.177105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-29eaee51-acc1-4b1c-9876-46c37ee2581f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1517 microversion: 2.1 time: 0.183499 May 26 21:22:28.178301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 129/273] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:27 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:28.197158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:28.198586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.206218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.207434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.216493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.216493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.235050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lazy-loading 'flavor' on Instance uuid 12d905a5-35e5-4d85-9ae5-a2c6406a9256 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:22:28.285745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:28.303631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-502935f3-f65a-4882-b845-54acea13a427 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.223752 May 26 21:22:28.304283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 145/274] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:28.484295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:28.485448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.497114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.497114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.497114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.497114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.630350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1ffac7d4-3ed0-4ae0-ac50-424432d61d1b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256/action" status: 200 len: 32 microversion: 2.1 time: 0.439081 May 26 21:22:28.631568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 130/275] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:22:28 2022] POST /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256/action => generated 32 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:22:28.638759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:28.642064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:28.642961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.648700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:28.650668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:28.652074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-99b9d27c-d691-4750-8445-5f6d932c0c95 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.173501 May 26 21:22:28.652369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.652873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.653241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 146/276] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:28 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:28.654378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.655204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.659104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:28.660389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:28.668805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.669080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:28.669976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:28.670525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.125549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.135706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ee557e1-4ffd-4f7b-b8cf-dfb31c2e5198 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.496152 May 26 21:22:29.138173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 131/277] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:29.149675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-89d479a3-aee9-4fc1-8841-c0340865f907 req-47ae0869-21ee-41cb-8803-5dbd38b9fcc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3748fe34-6403-4819-a21a-19fd842440b9", "name": "network-vif-plugged", "status": "completed", "tag": "8bf7c6f2-a31b-4347-a5f9-b986a9a803c3"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:29.158243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.169002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-77c5ebe9-1687-4128-b144-283f13cedcac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.514618 May 26 21:22:29.178790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 147/278] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:28 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:29.179028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-89d479a3-aee9-4fc1-8841-c0340865f907 req-47ae0869-21ee-41cb-8803-5dbd38b9fcc1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:29.179028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-89d479a3-aee9-4fc1-8841-c0340865f907 req-47ae0869-21ee-41cb-8803-5dbd38b9fcc1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.202603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-89d479a3-aee9-4fc1-8841-c0340865f907 req-47ae0869-21ee-41cb-8803-5dbd38b9fcc1 service nova] Creating event network-vif-plugged:8bf7c6f2-a31b-4347-a5f9-b986a9a803c3 for instance 3748fe34-6403-4819-a21a-19fd842440b9 on hv-cinder-82880 May 26 21:22:29.212484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-89d479a3-aee9-4fc1-8841-c0340865f907 req-47ae0869-21ee-41cb-8803-5dbd38b9fcc1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071211 May 26 21:22:29.213272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 132/279] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:29.320796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:29.321415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:29.327464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:29.328430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.329169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:29.329609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.512178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.526007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f0e6c394-2815-4a5e-b819-9a2f8d8a8e5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.209473 May 26 21:22:29.527428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 148/280] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:29.677524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:29.678710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:29.686158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:29.686941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.687923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:29.688564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:29.864857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.875443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.877022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:29.879463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-46794103-2e03-459a-97ad-1fa7d7e0be81 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.206935 May 26 21:22:29.892171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 133/281] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:29 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:30.155737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:30.156379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:30.162755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.163388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.167553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.167553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.188049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:30.189387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:30.197337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.197901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.198694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.199142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.747729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:30.758226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ec560057-9f8c-46e6-afdf-4e7a256f5613 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.606408 May 26 21:22:30.761190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 149/282] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:30.768006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:30.770788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:30.773190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:30.782690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c753f2a8-bb09-404d-8ab1-a7cd197e7043 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.596386 May 26 21:22:30.783326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 134/283] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:30 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:30.784662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.785831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.786855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.787634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.897538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:30.898585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:30.914435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.915134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.918487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:30.919143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:30.961105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:30.972915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-27dbb7a8-9731-4b1a-936c-50f4609b7c71 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.208476 May 26 21:22:30.991068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 150/284] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:31.105440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:31.115031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:31.116794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:31.118039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dbc124a3-843b-4548-9621-80c07b879887 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1408 microversion: 2.20 time: 0.224726 May 26 21:22:31.120622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 135/285] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:30 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1408 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:22:31.246133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-2f69a4e7-71f1-4b03-b396-51a61418d36d req-b178eb53-17f5-4f85-9a40-ca06c1b3cd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a593d7f5-c378-4a24-a59d-53fcf2e6ffcc", "name": "network-vif-plugged", "status": "completed", "tag": "2c2d13db-51bd-48b0-b8f7-bb7290971377"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:31.258748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f69a4e7-71f1-4b03-b396-51a61418d36d req-b178eb53-17f5-4f85-9a40-ca06c1b3cd5b service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:31.259198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f69a4e7-71f1-4b03-b396-51a61418d36d req-b178eb53-17f5-4f85-9a40-ca06c1b3cd5b service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:31.272059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-2f69a4e7-71f1-4b03-b396-51a61418d36d req-b178eb53-17f5-4f85-9a40-ca06c1b3cd5b service nova] Creating event network-vif-plugged:2c2d13db-51bd-48b0-b8f7-bb7290971377 for instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc on hv-cinder-82880 May 26 21:22:31.276411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-2f69a4e7-71f1-4b03-b396-51a61418d36d req-b178eb53-17f5-4f85-9a40-ca06c1b3cd5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037015 May 26 21:22:31.277052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 151/286] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:31.775982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:31.777292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:31.784383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:31.784964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:31.785762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:31.786195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:31.801273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:31.803080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:31.809816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:31.810578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:31.811567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:31.812227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:31.989319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:31.999722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d99feaa4-dbf5-4922-bd17-eff798c15c94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.226525 May 26 21:22:32.010278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 136/287] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:32.015210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:32.016038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:32.016323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:32.022171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.022833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.023749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.024180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ba4eaf7-dcac-4fe9-bdf8-5366c844d503 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.227237 May 26 21:22:32.024505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.025102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 152/288] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:31 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:32.137548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:32.138180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:32.147532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.147917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.148726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.151574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.199766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:32.211248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1a925e7-053f-4be1-9659-b1f4bd993fe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.199636 May 26 21:22:32.212012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 137/289] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:32.397854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:32.403945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:32.407142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:32.408521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-62fd2ca5-8080-4f34-9a2c-668293d7d9e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1599 microversion: 2.20 time: 0.276432 May 26 21:22:32.409442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 153/290] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:22:32 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1599 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:22:32.430685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:32.431189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:32.437280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.437730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.438755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:32.439403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:32.533189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3de45abc-f011-4acc-8196-c869f35ad2e2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107891 May 26 21:22:32.534010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 138/291] 10.222.0.66 () {60 vars in 1315 bytes} [Thu May 26 21:22:32 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:22:33.017580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:33.018197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:33.026432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.026432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.026432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.026432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.042373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:33.043670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:33.074616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.075615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.079996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.087514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.204999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:33.215093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f568d6f8-91ce-460c-882d-aebf40e42dd2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.201436 May 26 21:22:33.216003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 154/292] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:33.230413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:33.231243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:33.235186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:33.241471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.242193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.247431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:33.247431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:33.281987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:33.289779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e836bbd3-8057-4219-b185-16951c543dd0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.251666 May 26 21:22:33.290668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 139/293] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:33 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:33.397247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:33.417522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78b1d847-e905-4056-b041-cba8079d9b5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1362 microversion: 2.1 time: 0.189272 May 26 21:22:33.418690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 155/294] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:33.992276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-68dcc901-4559-429a-9e06-e4591771959e req-c15bff59-f008-464b-a278-6d2e2b41e400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:34.000410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-68dcc901-4559-429a-9e06-e4591771959e req-c15bff59-f008-464b-a278-6d2e2b41e400 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.000876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-68dcc901-4559-429a-9e06-e4591771959e req-c15bff59-f008-464b-a278-6d2e2b41e400 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.012394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-68dcc901-4559-429a-9e06-e4591771959e req-c15bff59-f008-464b-a278-6d2e2b41e400 service nova] Creating event network-changed:f05cef3c-e3f9-4f57-80cb-753ef76b7536 for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 on hv-cinder-82880 May 26 21:22:34.017382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-68dcc901-4559-429a-9e06-e4591771959e req-c15bff59-f008-464b-a278-6d2e2b41e400 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028737 May 26 21:22:34.018148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 140/295] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:34.374672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:34.374672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:34.374672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.374672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.376942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.376942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.378540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:34.378540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:34.378540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.378540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.379967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.379967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.435201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:34.443823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d342c662-fb93-4379-b2df-bee8deedeed1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1367 microversion: 2.1 time: 0.214777 May 26 21:22:34.445201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 156/296] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:34.459900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:34.462913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:34.477655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.478356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.479394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.479992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.591925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:34.602565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dbd201dd-25bb-4265-b44d-0db2d0966e41 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.299017 May 26 21:22:34.604481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 141/297] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:34 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:34.679695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:34.692382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-950c7161-de9b-4575-bc1b-299017701a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1548 microversion: 2.1 time: 0.245660 May 26 21:22:34.693353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 157/298] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:34.715192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:34.715691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:34.723935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.724397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.725405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:34.725994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:34.819283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de7b16a8-2dde-4b00-ba3a-aee26b4e6a5f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109031 May 26 21:22:34.819889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 142/299] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:22:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:35.461390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:35.462246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:35.468326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:35.469082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:35.469878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:35.470320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:35.620956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:35.621710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:35.627858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:35.628309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:35.629261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:35.629578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:36.069014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:36.080984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-67fa70ec-f158-42ae-954f-ba5197dc5dc4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1556 microversion: 2.1 time: 0.622996 May 26 21:22:36.092852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 158/300] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1556 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:36.099953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:36.100864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:36.107971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:36.108426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:36.109261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:36.109704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:36.133722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:36.142756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-953b3c3e-8950-42ea-abdf-bdce215a2bee tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.526247 May 26 21:22:36.144373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 143/301] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:35 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:36.273037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d1a8bd39-a7c8-45f8-ba20-980035491d8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177273 May 26 21:22:36.273617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 159/302] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:22:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:36.766602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-b5b59a20-4d36-468c-9c05-ac4f3fc767da req-0fe8478a-dfc7-4ae4-8521-07f326fac5a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3748fe34-6403-4819-a21a-19fd842440b9", "tag": "8bf7c6f2-a31b-4347-a5f9-b986a9a803c3"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:36.781208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b5b59a20-4d36-468c-9c05-ac4f3fc767da req-0fe8478a-dfc7-4ae4-8521-07f326fac5a8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:36.782498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b5b59a20-4d36-468c-9c05-ac4f3fc767da req-0fe8478a-dfc7-4ae4-8521-07f326fac5a8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:36.804712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-b5b59a20-4d36-468c-9c05-ac4f3fc767da req-0fe8478a-dfc7-4ae4-8521-07f326fac5a8 service nova] Creating event network-changed:8bf7c6f2-a31b-4347-a5f9-b986a9a803c3 for instance 3748fe34-6403-4819-a21a-19fd842440b9 on hv-cinder-82880 May 26 21:22:36.806390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-b5b59a20-4d36-468c-9c05-ac4f3fc767da req-0fe8478a-dfc7-4ae4-8521-07f326fac5a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047465 May 26 21:22:36.807500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 144/303] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:37.160744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:37.161357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:37.173801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:37.180314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:37.180314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:37.180314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:37.375716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:37.381126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db715bb7-c56a-4d00-947e-bd495b10e863 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.224217 May 26 21:22:37.381773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 160/304] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:37 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:37.513562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-40fd7caf-9325-44dd-8857-27ba7bbf73dc req-973da1cc-fc35-4402-9d0e-060d0d25b472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a593d7f5-c378-4a24-a59d-53fcf2e6ffcc", "tag": "2c2d13db-51bd-48b0-b8f7-bb7290971377"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:37.524668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40fd7caf-9325-44dd-8857-27ba7bbf73dc req-973da1cc-fc35-4402-9d0e-060d0d25b472 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:37.526626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40fd7caf-9325-44dd-8857-27ba7bbf73dc req-973da1cc-fc35-4402-9d0e-060d0d25b472 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:37.530414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:37.539284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-40fd7caf-9325-44dd-8857-27ba7bbf73dc req-973da1cc-fc35-4402-9d0e-060d0d25b472 service nova] Creating event network-changed:2c2d13db-51bd-48b0-b8f7-bb7290971377 for instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc on hv-cinder-82880 May 26 21:22:37.544976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-40fd7caf-9325-44dd-8857-27ba7bbf73dc req-973da1cc-fc35-4402-9d0e-060d0d25b472 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036260 May 26 21:22:37.545576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 145/305] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:38.398537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:38.399357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:38.406638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:38.407372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:38.408314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:38.408938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:38.593491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:38.601748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9bf22c4c-bde2-4e77-a58f-8d243b829514 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.207122 May 26 21:22:38.602697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 161/306] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:38 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:39.620986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:39.621789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:39.628566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:39.629670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:39.630440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:39.630884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:39.774661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:39.786044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3d163fee-f6dc-488a-86d0-c6f60a04b5dd tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.170091 May 26 21:22:39.786640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 146/307] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:39 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:40.813402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:40.814195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:40.828893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:40.829366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:40.830701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:40.831148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:40.837330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:41.253364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:41.262375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4b0ca062-8284-4d18-b898-9fff004b29f3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.455937 May 26 21:22:41.263353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 162/308] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:40 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:42.282469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:42.285637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:42.295196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:42.298315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:42.298315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:42.298315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:42.924739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:42.954480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-888874a6-8974-429e-b6d1-f31fbfe5b2e3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.678627 May 26 21:22:42.965900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 147/309] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:42 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:43.035591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:43.039320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:43.043017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.043472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:43.044260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.044766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:43.074806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:22:43.424302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-11599494-0421-4fe6-abc8-244e055102b4 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 204 len: 0 microversion: 2.1 time: 0.393291 May 26 21:22:43.425290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 163/310] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:22:43 2022] DELETE /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:22:43.435984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:43.436726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:43.444768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=76 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:22:43.446507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.447019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:43.447809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.448250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:43.681112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:43.690067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d9bc0fb2-a127-4b9c-a2dc-cda6e62c317e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1554 microversion: 2.1 time: 0.259089 May 26 21:22:43.690949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 148/311] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:43 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:43.972121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:43.972968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:43.979043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.979488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:43.980314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:43.980782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:44.234853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:44.243819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1d45ae9a-6900-44d9-882b-8fc99892c035 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.275949 May 26 21:22:44.245095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 164/312] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:43 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:44.708245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:44.709404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:44.718556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:44.719019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:44.720434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:44.721122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:44.942686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:44.957500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8663a938-7dcb-45ea-84a6-fc213aa46dc6 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1554 microversion: 2.1 time: 0.253194 May 26 21:22:44.958282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 149/313] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:44 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:45.271178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:45.271865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:45.278586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:45.279411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:45.280206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:45.280851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:45.648222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:45.659214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae1b1cda-db26-41c6-977b-fec9b0813d04 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.392762 May 26 21:22:45.659800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 165/314] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:45 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:45.974837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:45.975555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:45.982918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:45.983454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:45.984298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:45.984839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:46.319031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:46.327468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96de6de5-561a-4e8a-a853-2943d66e1470 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1554 microversion: 2.1 time: 0.356602 May 26 21:22:46.328905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 150/315] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:45 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1554 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:46.678965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:46.679590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:46.687120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:46.688000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:46.689457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:46.690276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:47.040101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:47.052986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1f4f05d0-38b9-4184-ba21-e1ed77189c8a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.379619 May 26 21:22:47.053595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 166/316] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:46 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:47.273456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-629b13f1-0cf7-440f-b888-dd53f9bd4411 req-120f3d00-8d99-4419-9789-914ba94697d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3546719-ea65-4d99-bb86-ae1d6c62a867", "name": "network-vif-deleted", "tag": "a6173aff-5c1e-4cda-b784-150fc80aa28a"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:47.287917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-629b13f1-0cf7-440f-b888-dd53f9bd4411 req-120f3d00-8d99-4419-9789-914ba94697d9 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:47.287917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-629b13f1-0cf7-440f-b888-dd53f9bd4411 req-120f3d00-8d99-4419-9789-914ba94697d9 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:47.301596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-629b13f1-0cf7-440f-b888-dd53f9bd4411 req-120f3d00-8d99-4419-9789-914ba94697d9 service nova] Creating event network-vif-deleted:a6173aff-5c1e-4cda-b784-150fc80aa28a for instance d3546719-ea65-4d99-bb86-ae1d6c62a867 on hv-cinder-82880 May 26 21:22:47.307600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-629b13f1-0cf7-440f-b888-dd53f9bd4411 req-120f3d00-8d99-4419-9789-914ba94697d9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037587 May 26 21:22:47.308371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 151/317] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:47.349034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:47.349653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:47.367413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:47.367866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:47.371250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:47.371250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:47.448881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:47.458432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a476e326-8ffe-4ed0-82f1-813f039100cd tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1512 microversion: 2.1 time: 0.117266 May 26 21:22:47.461210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 167/318] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:47 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1512 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:48.071098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:48.071851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:48.084401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:48.085013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:48.085873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:48.086802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:48.257625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:48.268990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17005361-e1d4-4193-9670-8bfe1c15be48 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.202517 May 26 21:22:48.270493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 152/319] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:48 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:48.476934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:48.477554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:48.495418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:48.495897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:48.497800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:48.498251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:48.550387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:48.550877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:48.551402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lazy-loading 'fault' on Instance uuid d3546719-ea65-4d99-bb86-ae1d6c62a867 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:22:48.641628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce2de523c23948c8b9b652c9263b9240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90703a330f8940989ec1fa3b82fe4976', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:48.659936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eb12b4d9-d077-4e42-87ae-7b50f3da1cfe tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 200 len: 1351 microversion: 2.1 time: 0.187759 May 26 21:22:48.661297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 168/320] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:48 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 1351 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:49.289879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:49.291315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:49.299286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.300093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.301168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.301895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.498982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:49.509351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-809fbd8e-de99-4fc2-8610-ffe054e474dc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.225338 May 26 21:22:49.511911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 153/321] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:49 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:49.681615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:49.683292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:49.690467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.691866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.692969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.693870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.710884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] HTTP exception thrown: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Request method failure captured: May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 HTTP/1.1 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-85DXXlLodFJxBQTX7KNRodkGvy11dWVI78yLtCm8RHOwIVz-lrlzsqob-YOsrLXYxebfP5cf1vQ-V-nlB46RnGX5IIf72rwGP9Ox23JeHp7gU3MD_uOVHdULqxbTQuhkHFRPBlZ-Uq3PE92nRY7ERjdXBXh2PniygmqjQFgfpdTcA May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:22:49.716934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: ce2de523c23948c8b9b652c9263b9240 May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.718301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'd3546719-ea65-4d99-bb86-ae1d6c62a867'} May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:22:49.719010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.720138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:49.722550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Returning 404 to user: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:22:49.723684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-81a15af4-2db4-44f8-b8b3-ba5687f5e0a9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 404 len: 111 microversion: 2.1 time: 0.048751 May 26 21:22:49.725978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 169/322] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:49 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:22:49.884918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:49.885870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:49.893717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.893717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.894835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:49.895286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:49.916352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] HTTP exception thrown: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Request method failure captured: May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867/os-volume_attachments HTTP/1.1 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-85DXXlLodFJxBQTX7KNRodkGvy11dWVI78yLtCm8RHOwIVz-lrlzsqob-YOsrLXYxebfP5cf1vQ-V-nlB46RnGX5IIf72rwGP9Ox23JeHp7gU3MD_uOVHdULqxbTQuhkHFRPBlZ-Uq3PE92nRY7ERjdXBXh2PniygmqjQFgfpdTcA May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:22:49.925141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: ce2de523c23948c8b9b652c9263b9240 May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.927088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'd3546719-ea65-4d99-bb86-ae1d6c62a867'} May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:22:49.927966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:49.929381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:49.931519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Returning 404 to user: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:22:49.932977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a7a2d802-5d58-4368-9b71-b5c3d023976e tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051992 May 26 21:22:49.938303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 154/323] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:22:49 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867/os-volume_attachments => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:22:50.536065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:50.537360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:50.552819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:50.553775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:50.554798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:50.555406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:51.097453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:51.108278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c7ef592-08f8-4be4-92b3-878a56a4cc05 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.576344 May 26 21:22:51.109056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 170/324] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:50 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:51.352532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:51.353337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:51.360533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:51.361137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:51.361999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:51.362647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:51.378483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] HTTP exception thrown: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Request method failure captured: May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 HTTP/1.1 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-85DXXlLodFJxBQTX7KNRodkGvy11dWVI78yLtCm8RHOwIVz-lrlzsqob-YOsrLXYxebfP5cf1vQ-V-nlB46RnGX5IIf72rwGP9Ox23JeHp7gU3MD_uOVHdULqxbTQuhkHFRPBlZ-Uq3PE92nRY7ERjdXBXh2PniygmqjQFgfpdTcA May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:22:51.381506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: ce2de523c23948c8b9b652c9263b9240 May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.382814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'd3546719-ea65-4d99-bb86-ae1d6c62a867'} May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:22:51.383481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.389178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:22:51.390411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Returning 404 to user: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:22:51.390411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-238cd08c-94d2-455d-a654-4d9d34f8e6b9 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 404 len: 111 microversion: 2.1 time: 0.034640 May 26 21:22:51.390411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 155/325] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:22:51 2022] DELETE /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:22:51.395936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:51.396821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] [instance: d3546719-ea65-4d99-bb86-ae1d6c62a867] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:51.404544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:51.405023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:51.405823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:51.406260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:51.421918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] HTTP exception thrown: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Request method failure captured: May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 HTTP/1.1 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-85DXXlLodFJxBQTX7KNRodkGvy11dWVI78yLtCm8RHOwIVz-lrlzsqob-YOsrLXYxebfP5cf1vQ-V-nlB46RnGX5IIf72rwGP9Ox23JeHp7gU3MD_uOVHdULqxbTQuhkHFRPBlZ-Uq3PE92nRY7ERjdXBXh2PniygmqjQFgfpdTcA May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:22:51.423358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/90703a330f8940989ec1fa3b82fe4976"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 90703a330f8940989ec1fa3b82fe4976 May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-DeleteServersTestJSON-1691084701 May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: ce2de523c23948c8b9b652c9263b9240 May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-DeleteServersTestJSON-1691084701-project May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.424897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'd3546719-ea65-4d99-bb86-ae1d6c62a867'} May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:22:51.426380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. May 26 21:22:51.427716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:22:51.428998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] Returning 404 to user: Instance d3546719-ea65-4d99-bb86-ae1d6c62a867 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:22:51.428998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9eb28ae6-7e2a-4cae-8f6f-c44f1c485844 tempest-DeleteServersTestJSON-1691084701 tempest-DeleteServersTestJSON-1691084701-project] 10.222.0.66 "GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867" status: 404 len: 111 microversion: 2.1 time: 0.033355 May 26 21:22:51.432923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 171/326] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:51 2022] GET /compute/v2.1/servers/d3546719-ea65-4d99-bb86-ae1d6c62a867 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:22:52.126912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:52.128095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:52.137861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:52.140322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:52.140322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:52.140322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:52.439311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:52.458315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-69cf88a7-5e8b-45d5-acec-14f4900aac33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.336608 May 26 21:22:52.464701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 156/327] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:52 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:53.486045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:53.486729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:53.494331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:53.494788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:53.495571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:53.496013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:53.698266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:53.709519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d2519559-7028-482e-b17a-1bc4933f76ea tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.231860 May 26 21:22:53.720768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 172/328] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:53 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:54.738654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:54.741289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:54.750097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:54.750797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:54.751848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:54.752361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:54.976924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:54.987206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-99121465-9672-46b9-a945-cd1cf465e908 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.264316 May 26 21:22:54.989879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 157/329] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:54 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:55.219499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9fea9271-4ba9-4ef4-b25d-5ca5b68ad8f7 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Action: 'create', calling method: .version_select at 0x7f46c8d575e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1306328953"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:55.532682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e96cd76-30d9-4a5b-a9ee-ca94f9027111 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Action: 'create', calling method: .version_select at 0x7f46c8482280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1795338453", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTita9Ie2X5IrsQv68IrUjJDTKYE7Om24ylLqEm2UGMTxQgJjw4Zz/LjlQilhxLW0fC62ix2b0yD0ETUIUAT/m928gF2RKwWl3WFBh1nBu5Xn296qr125xbfThtmdAuqQ=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:55.550185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-2e96cd76-30d9-4a5b-a9ee-ca94f9027111 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:22:55.555519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-2e96cd76-30d9-4a5b-a9ee-ca94f9027111 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for user b3efa221fe5843cbb3671f4a3512f83b and project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:22:55.637439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2e96cd76-30d9-4a5b-a9ee-ca94f9027111 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.239343 May 26 21:22:55.638077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 158/330] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:22:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:22:56.008603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:56.009230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:56.017368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:56.018202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:56.019010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:56.019449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:56.023654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9fea9271-4ba9-4ef4-b25d-5ca5b68ad8f7 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.074934 May 26 21:22:56.024265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 173/331] 10.222.0.66 () {60 vars in 1154 bytes} [Thu May 26 21:22:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1076 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 26 21:22:56.036713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-611e9802-4e24-4f42-9d4d-ad5dd1bcb8a4 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bce700>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:56.105042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-611e9802-4e24-4f42-9d4d-ad5dd1bcb8a4 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 200 len: 345 microversion: 2.1 time: 0.072975 May 26 21:22:56.105958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 174/332] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:22:56 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:22:56.188203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:56.197134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a4238454-f2e3-43ea-ba4d-dfbffad9d906 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.194976 May 26 21:22:56.197718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 159/333] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:56 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:57.119383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-702ddd07-cbdb-454b-a19a-200abbbc7095 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bea3a0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:57.171134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-702ddd07-cbdb-454b-a19a-200abbbc7095 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 200 len: 345 microversion: 2.1 time: 0.055187 May 26 21:22:57.176510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 175/334] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:22:57 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:57.215729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:57.218518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:57.231725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:57.234322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:57.237321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:57.238920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:57.422575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:57.430908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-02948465-e3f0-4572-b78c-7d9ec6351680 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.219570 May 26 21:22:57.431527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 160/335] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:57 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:22:58.183381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b31f9c30-e579-4d82-a9d5-fbbb91c9f9ec tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8c2cf70>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:58.236451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b31f9c30-e579-4d82-a9d5-fbbb91c9f9ec tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 200 len: 346 microversion: 2.1 time: 0.056780 May 26 21:22:58.237074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 176/336] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:22:58 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 346 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:58.248220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-80885d90-0c9e-46ca-9d0b-94bcfcbc9e24 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Action: 'create', calling method: .version_select at 0x7f46c836b160>, body: {"snapshot": {"volume_id": "6ac4fdbd-fdf2-41f9-91da-d18781cf621f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-970738685"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:22:58.447981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:58.448700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:58.455460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:58.456502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:58.458267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:58.458880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:58.610524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:58.633167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-249523bb-0c3d-4669-ba82-79646448cdff tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.178859 May 26 21:22:58.633167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 177/337] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:58 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:22:58.832685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-80885d90-0c9e-46ca-9d0b-94bcfcbc9e24 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.588118 May 26 21:22:58.833799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 161/338] 10.222.0.66 () {60 vars in 1161 bytes} [Thu May 26 21:22:58 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:58.845359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f78773a8-2aa1-4a3d-894c-a437c539c73f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8c2cf70>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:59.486754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f78773a8-2aa1-4a3d-894c-a437c539c73f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.646392 May 26 21:22:59.493923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 178/339] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:22:58 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:59.508126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ab601536-4e68-40bb-af8d-6ad23d8bf210 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8313310>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:59.605976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ab601536-4e68-40bb-af8d-6ad23d8bf210 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.106314 May 26 21:22:59.606612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 162/340] 10.222.0.66 () {58 vars in 1139 bytes} [Thu May 26 21:22:59 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:59.629928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-26d6080f-afd8-4e16-a090-d98b78a9fa31 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bceaf0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:59.648272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:22:59.648272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:22:59.657124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:59.658675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:59.662206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:22:59.663227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:22:59.685445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-26d6080f-afd8-4e16-a090-d98b78a9fa31 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.059863 May 26 21:22:59.686200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 179/341] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:22:59 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:22:59.813499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:22:59.821078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31e8021f-112d-49cf-aea7-922ab97216c0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.183455 May 26 21:22:59.821658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 163/342] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:22:59 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:00.698010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f27f876-c1d8-4f31-8acf-ea9c6a08bf8f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bce940>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:00.731679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f27f876-c1d8-4f31-8acf-ea9c6a08bf8f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.037601 May 26 21:23:00.732444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 180/343] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:00 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:00.838779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:00.839726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:00.846401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:00.846957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:00.847789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:00.848234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:00.974426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:00.981918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d72e9649-0f5f-4239-9d84-b02452e81de9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.147002 May 26 21:23:00.982609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 164/344] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:00 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:01.743778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8e8ccda4-95e9-4195-adff-ada19656b65b tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8d575e0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:01.775834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8e8ccda4-95e9-4195-adff-ada19656b65b tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.035819 May 26 21:23:01.776411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 181/345] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:01 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:02.003137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:02.004967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:02.011755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:02.012228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:02.013019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:02.013453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:02.153534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:02.161340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d3e12aa6-b3f8-4c3c-85eb-39a22b0dcf8f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.165541 May 26 21:23:02.161905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 165/346] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:01 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:02.788415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9106afa6-d1f7-4546-a6d9-7daea89721b8 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bce1f0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:02.817770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9106afa6-d1f7-4546-a6d9-7daea89721b8 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.033610 May 26 21:23:02.818350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 182/347] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:02 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:23:03.178222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:03.178779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:03.185775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:03.186217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:03.186968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:03.187401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:03.321173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:03.328969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6ebf571c-4444-4272-971a-5172cd63146e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.154570 May 26 21:23:03.329558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 166/348] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:03 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:03.829734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5c28dbac-17fd-460a-b3af-6a7be345c7db tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bceaf0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:03.860035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5c28dbac-17fd-460a-b3af-6a7be345c7db tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.034192 May 26 21:23:03.860719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 183/349] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:03 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:04.347140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:04.347786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:04.354396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:04.354841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:04.355599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:04.356032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:04.370946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:04.490060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:04.497536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6c7a173c-1d62-4154-b8e5-e99e03998356 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.154260 May 26 21:23:04.498108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 167/350] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:04 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:04.871811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-18c4d78f-f59e-4517-97cc-daeab1acd86e tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bea700>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:04.901787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-18c4d78f-f59e-4517-97cc-daeab1acd86e tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.033844 May 26 21:23:04.903332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 184/351] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:04 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:05.515116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:05.515844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:05.523037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:05.523496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:05.524275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:05.524763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:05.564248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:05.657043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:05.664674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-162e73d8-5d37-4e41-8b2d-c75e7af1e8b4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.153448 May 26 21:23:05.670243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 168/352] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:05 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:05.915221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bc16e83b-ef5c-4f0c-98f5-9602852febf6 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bceee0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:05.944872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bc16e83b-ef5c-4f0c-98f5-9602852febf6 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.034412 May 26 21:23:05.945439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 185/353] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:05 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:06.681249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:06.681870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:06.689664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:06.696099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:06.696099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:06.696099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:06.828355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:06.837617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b84b10ce-1cbd-4a6f-8b80-f80f02c1128e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.160132 May 26 21:23:06.838237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 169/354] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:06 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:06.957626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ee5162c-5c8c-4921-9586-277e7ce7ab0f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bce670>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:06.986675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ee5162c-5c8c-4921-9586-277e7ce7ab0f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 287 microversion: 2.1 time: 0.033440 May 26 21:23:06.987232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 186/355] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:06 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:06.997330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3f5571d1-c348-4d8c-9f55-000acaead264 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c836e700>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:07.140372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3f5571d1-c348-4d8c-9f55-000acaead264 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 202 len: 0 microversion: 2.1 time: 0.146740 May 26 21:23:07.140994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 170/356] 10.222.0.66 () {58 vars in 1253 bytes} [Thu May 26 21:23:06 2022] DELETE /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:23:07.149984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6ae62b3e-82a5-427b-b846-54c79f0a683b tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8d57af0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:07.183061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6ae62b3e-82a5-427b-b846-54c79f0a683b tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.036991 May 26 21:23:07.183635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 187/357] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:07 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:23:07.854742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:07.855308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:07.861456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:07.861914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:07.862724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:07.863732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:08.008721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:08.016219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-557cf23b-dcc6-4318-82c7-fd1a298f89ae tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.165900 May 26 21:23:08.016874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 171/358] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:07 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:08.195093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd981417-9f29-4008-8c21-9367999983be tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bea550>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:08.229249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dd981417-9f29-4008-8c21-9367999983be tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 200 len: 286 microversion: 2.1 time: 0.034543 May 26 21:23:08.229249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 188/359] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:08 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:09.035998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:09.036672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:09.046247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:09.046247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:09.046247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:09.046247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:09.186251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:09.194374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-550ded07-937b-482b-b48d-db148c440fc7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.163672 May 26 21:23:09.194942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 172/360] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:09 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:09.235761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:09.236542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:09.241087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8a642e80-623a-4230-a78c-06e7e3e3f950 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8d57c10>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:09.266943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-8a642e80-623a-4230-a78c-06e7e3e3f950 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] HTTP exception thrown: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8a642e80-623a-4230-a78c-06e7e3e3f950 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Request method failure captured: May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 HTTP/1.1 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij--uu8OaqkA8pDLKoSwlHqoZDjaBSucE16BeJopldDLdnA66Kx7IMLCCcRoGK-sZUZF5FZV4ULxKrrnsg9dQdgseP67V4GxuChiqd_gzKQ4MwUuzdAJTkbyn7pX629yejqeTZ3wOc7qxHDtiAcGL0gjyXXuBxYhcLcETTqH1NXT6NGY May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:23:09.269796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 90f99e434798434c93041c3c62fd153f May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'c8921cc3-daa3-400b-8e3d-f53aceaeaa60'} May 26 21:23:09.271041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. (HTTP 404) (Request-ID: req-4d89643f-3074-466b-808d-b06ce75a1f7e) May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.271827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:09.272912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 26 21:23:09.273973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8a642e80-623a-4230-a78c-06e7e3e3f950 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Returning 404 to user: Snapshot c8921cc3-daa3-400b-8e3d-f53aceaeaa60 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8a642e80-623a-4230-a78c-06e7e3e3f950 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60" status: 404 len: 111 microversion: 2.1 time: 0.037033 May 26 21:23:09.275155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 189/361] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 21:23:09 2022] GET /compute/v2.1/os-snapshots/c8921cc3-daa3-400b-8e3d-f53aceaeaa60 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:23:09.281235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c842f492-0ae5-487c-97ce-37a4a792296f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c82b5ee0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:09.532314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c842f492-0ae5-487c-97ce-37a4a792296f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 202 len: 0 microversion: 2.1 time: 0.250928 May 26 21:23:09.532622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 173/362] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:23:09 2022] DELETE /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:23:09.538569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-98b31f19-3814-4378-961e-9e3313ac30f1 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bced30>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:09.596516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-98b31f19-3814-4378-961e-9e3313ac30f1 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 200 len: 345 microversion: 2.1 time: 0.063037 May 26 21:23:09.597219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 190/363] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:09 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:23:10.214839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:10.215836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:10.221722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:10.226069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:10.226069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:10.226069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:10.362342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:10.369920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b54aa068-9360-4292-94d1-a108f42750b7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.159515 May 26 21:23:10.370485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 174/364] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:10 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:10.608611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-befaa0e0-bcfa-4393-b9aa-bf24083437bc tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8c2ce50>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:10.637162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-befaa0e0-bcfa-4393-b9aa-bf24083437bc tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] HTTP exception thrown: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-befaa0e0-bcfa-4393-b9aa-bf24083437bc tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Request method failure captured: May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f HTTP/1.1 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij--uu8OaqkA8pDLKoSwlHqoZDjaBSucE16BeJopldDLdnA66Kx7IMLCCcRoGK-sZUZF5FZV4ULxKrrnsg9dQdgseP67V4GxuChiqd_gzKQ4MwUuzdAJTkbyn7pX629yejqeTZ3wOc7qxHDtiAcGL0gjyXXuBxYhcLcETTqH1NXT6NGY May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:23:10.639136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 90f99e434798434c93041c3c62fd153f May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '6ac4fdbd-fdf2-41f9-91da-d18781cf621f'} May 26 21:23:10.640420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. (HTTP 404) (Request-ID: req-2b68920c-c03f-4120-9006-6a54c0100afd) May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.641381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:10.642643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:23:10.643944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-befaa0e0-bcfa-4393-b9aa-bf24083437bc tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Returning 404 to user: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-befaa0e0-bcfa-4393-b9aa-bf24083437bc tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 404 len: 109 microversion: 2.1 time: 0.035820 May 26 21:23:10.645617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 191/365] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:10 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:23:10.652021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e7609f2-a31c-4d50-8f7f-978ae085fb34 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8330c10>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:10.680768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-9e7609f2-a31c-4d50-8f7f-978ae085fb34 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] HTTP exception thrown: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e7609f2-a31c-4d50-8f7f-978ae085fb34 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Request method failure captured: May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f HTTP/1.1 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--uu8OaqkA8pDLKoSwlHqoZDjaBSucE16BeJopldDLdnA66Kx7IMLCCcRoGK-sZUZF5FZV4ULxKrrnsg9dQdgseP67V4GxuChiqd_gzKQ4MwUuzdAJTkbyn7pX629yejqeTZ3wOc7qxHDtiAcGL0gjyXXuBxYhcLcETTqH1NXT6NGY May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:23:10.682719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 90f99e434798434c93041c3c62fd153f May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '6ac4fdbd-fdf2-41f9-91da-d18781cf621f'} May 26 21:23:10.684140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. (HTTP 404) (Request-ID: req-3285c1fb-bbe7-41d9-8b45-e249e838d14a) May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.685050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 26 21:23:10.686280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 26 21:23:10.687494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e7609f2-a31c-4d50-8f7f-978ae085fb34 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Returning 404 to user: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e7609f2-a31c-4d50-8f7f-978ae085fb34 tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 404 len: 109 microversion: 2.1 time: 0.036578 May 26 21:23:10.688675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 175/366] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:23:10 2022] DELETE /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:23:10.693567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-668f5585-4ede-4114-a6a7-775b5a413c5f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Calling method '.version_select at 0x7f46c8bce280>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:10.722282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-668f5585-4ede-4114-a6a7-775b5a413c5f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] HTTP exception thrown: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-668f5585-4ede-4114-a6a7-775b5a413c5f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Request method failure captured: May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f HTTP/1.1 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij--uu8OaqkA8pDLKoSwlHqoZDjaBSucE16BeJopldDLdnA66Kx7IMLCCcRoGK-sZUZF5FZV4ULxKrrnsg9dQdgseP67V4GxuChiqd_gzKQ4MwUuzdAJTkbyn7pX629yejqeTZ3wOc7qxHDtiAcGL0gjyXXuBxYhcLcETTqH1NXT6NGY May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:23:10.724407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9ad28914703a493b9b86ffbf5061f362"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 9ad28914703a493b9b86ffbf5061f362 May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-470569023 May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 90f99e434798434c93041c3c62fd153f May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotsTestJSON-470569023-project May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '6ac4fdbd-fdf2-41f9-91da-d18781cf621f'} May 26 21:23:10.725821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. (HTTP 404) (Request-ID: req-21f76b46-82eb-410a-ad75-f8b214ac6356) May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.726681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi item = cinderclient( May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 26 21:23:10.727888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 26 21:23:10.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-668f5585-4ede-4114-a6a7-775b5a413c5f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] Returning 404 to user: Volume 6ac4fdbd-fdf2-41f9-91da-d18781cf621f could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-668f5585-4ede-4114-a6a7-775b5a413c5f tempest-VolumesSnapshotsTestJSON-470569023 tempest-VolumesSnapshotsTestJSON-470569023-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f" status: 404 len: 109 microversion: 2.1 time: 0.036811 May 26 21:23:10.730390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 192/367] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:10 2022] GET /compute/v2.1/os-volumes/6ac4fdbd-fdf2-41f9-91da-d18781cf621f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:23:11.396255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:11.397771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:11.407007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:11.407720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:11.408848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:11.409143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:11.561840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:11.571226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9dfe853f-13ab-4e0e-bc5c-540eca3d0d76 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.181001 May 26 21:23:11.572217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 176/368] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:11 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:12.589264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:12.589873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:12.596405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:12.597052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:12.598358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:12.598874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:12.751968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:12.759099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3fe1e5ae-0dcb-4ee4-adad-8d8d2b5b9419 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.173713 May 26 21:23:12.759684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 193/369] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:12 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:13.775994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:13.776686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:13.780382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:13.786080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:13.786804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:13.787633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:13.788266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:13.932844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:13.942133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15c4ca1e-dc4e-4f81-a10f-4337c0a6c486 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.169817 May 26 21:23:13.942862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 177/370] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:13 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:14.959580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:14.960381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:14.966556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:14.967012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:14.967775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:14.968212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:15.193608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:15.201878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3838079e-d0b0-4933-8b20-bf53014d527d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.246214 May 26 21:23:15.202459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 194/371] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:14 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:16.220168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:16.220875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:16.228729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:16.229591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:16.230171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:16.230394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:16.331576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-53a40bb3-9caa-4bb9-8276-51342512c740 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8bce040>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:16.377351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:16.385761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f7639b31-a7a1-48db-b538-04cbf244ca86 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.170124 May 26 21:23:16.388138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 178/372] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:16 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:16.390933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-53a40bb3-9caa-4bb9-8276-51342512c740 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/222f4dbb-e96b-483b-af2f-45b53ae97ace" status: 200 len: 350 microversion: 2.1 time: 0.063020 May 26 21:23:16.391499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 195/373] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:16 2022] GET /compute/v2.1/os-volumes/222f4dbb-e96b-483b-af2f-45b53ae97ace => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:23:17.404277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:17.405208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:17.412326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:17.412874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:17.413653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:17.414170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:17.553209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:17.562044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f0ef4665-da5e-4805-b0f5-e46214bc003d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.161777 May 26 21:23:17.562703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 179/374] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:17 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:18.583060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:18.583675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:18.590507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:18.590966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:18.591760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:18.592199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:18.727598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:18.735202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f845e35f-f33a-44c6-b813-59e6cf398ff4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.156236 May 26 21:23:18.735766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 196/375] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:18 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:19.752274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:19.752945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:19.759126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:19.759573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:19.760323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:19.760785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:19.893480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:19.900871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a1dc81a5-8105-4a1e-89a9-6999445dad0e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1523 microversion: 2.1 time: 0.152370 May 26 21:23:19.901426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 180/376] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:19 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:20.918095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:20.918633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:20.925471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:20.925471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:20.927120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:20.927218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:21.058790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:21.066690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5cc67021-ac8a-44bf-af97-1000824d8ef3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1503 microversion: 2.1 time: 0.152485 May 26 21:23:21.067375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 197/377] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:20 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:21.082389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:21.083001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:21.090472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:21.090999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:21.091797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:21.092356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:21.224686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:21.234781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fb976ef0-4e55-4c54-8c9e-7dec409af9e6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1515 microversion: 2.1 time: 0.156146 May 26 21:23:21.235368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 181/378] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:21 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:26.485268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c395cb62-042e-4d0f-8308-5fe914644884 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8bce820>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:26.534041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c395cb62-042e-4d0f-8308-5fe914644884 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/db9d3474-ca87-41d9-a01b-deceeee59db4" status: 200 len: 351 microversion: 2.1 time: 0.052558 May 26 21:23:26.534626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 198/379] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:26 2022] GET /compute/v2.1/os-volumes/db9d3474-ca87-41d9-a01b-deceeee59db4 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:28.025407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-975230810", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "networks": [{"uuid": "526371f6-9a9a-4438-80fe-61698cbae557"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:28.080380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] validate_networks() for [('526371f6-9a9a-4438-80fe-61698cbae557', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:23:28.432570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:23:28.433050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:23:28.433528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:23:28.433937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:23:28.434345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:23:28.443203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:28.443648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:28.444443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:28.444921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:28.461335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Getting quotas for project 8c5f36ef25b441e4a4e019765530f370. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:23:28.465343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Getting quotas for user 596dd83622cd4fddbccbb70a98a970bc and project 8c5f36ef25b441e4a4e019765530f370. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:23:28.476987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:23:28.479246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:23:28.649492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de164281-b88a-4bab-9e9f-07522784ff08 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627869 May 26 21:23:28.650139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 182/380] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:23:28.660789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4d0a8cee-2ffc-480b-a9fa-bb9d2f618217 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:28.661420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4d0a8cee-2ffc-480b-a9fa-bb9d2f618217 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:28.718716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4d0a8cee-2ffc-480b-a9fa-bb9d2f618217 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:28.726084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4d0a8cee-2ffc-480b-a9fa-bb9d2f618217 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1213 microversion: 2.1 time: 0.069641 May 26 21:23:28.726661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 199/381] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:28 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:29.743753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:29.744495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:29.754414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:29.754869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:29.755645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:29.756082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:29.817828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:29.826915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c3799966-2063-4d85-a99e-4152018d49b1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1217 microversion: 2.1 time: 0.087423 May 26 21:23:29.827503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 183/382] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:29 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:30.260206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:30.261241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:30.268190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.268685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.270146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.270404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.295786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lazy-loading 'flavor' on Instance uuid a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:23:30.645678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c2be9066-9bfc-47cf-91e0-4cdddd770745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/action" status: 200 len: 32 microversion: 2.1 time: 0.388604 May 26 21:23:30.646302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 200/383] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:23:30 2022] POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/action => generated 32 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:23:30.655525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:30.656143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:30.662158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.662616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.663379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.663821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.800624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:30.809009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d5afd8ca-e226-47f4-be49-852beb3e86b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.157335 May 26 21:23:30.809590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 184/384] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:30 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:30.843946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:30.844722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:30.851297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.851761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.852528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:30.852997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:30.962501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:30.970949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6bec0252-a9cd-4546-80a6-b90b5dcdd9ad tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1265 microversion: 2.1 time: 0.131108 May 26 21:23:30.971533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 201/385] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:30 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1265 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:31.238891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a501c4b-2ea6-4fce-93c8-05abb4f0c03a tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c83138b0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.292319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a501c4b-2ea6-4fce-93c8-05abb4f0c03a tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/40eac660-51dd-486c-a474-ef5190dcb286" status: 200 len: 350 microversion: 2.1 time: 0.057776 May 26 21:23:31.293122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 185/386] 10.222.0.66 () {58 vars in 1244 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes/40eac660-51dd-486c-a474-ef5190dcb286 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:31.305258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6226c891-a4d2-438d-8566-532924b6a52c tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8bce040>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.435653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6226c891-a4d2-438d-8566-532924b6a52c tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.134812 May 26 21:23:31.436800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 202/387] 10.222.0.66 () {58 vars in 1133 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:31.450669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-59e58ba1-1f03-493a-96d0-41621527f34d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8313a60>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.539190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-59e58ba1-1f03-493a-96d0-41621527f34d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093568 May 26 21:23:31.539769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 186/388] 10.222.0.66 () {58 vars in 1148 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:31.554343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5e69ea3-3e7e-42a5-9747-dfe88fafe10b tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8b7c8b0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.646950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5e69ea3-3e7e-42a5-9747-dfe88fafe10b tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097042 May 26 21:23:31.648400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 203/389] 10.222.0.66 () {58 vars in 1133 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:31.659857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c8202369-fe84-4929-bc33-8733c877455d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c83303a0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.745431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c8202369-fe84-4929-bc33-8733c877455d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089235 May 26 21:23:31.746090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 187/390] 10.222.0.66 () {58 vars in 1166 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:31.757936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f34bd641-3efe-429c-b2ee-a76a13cc3104 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8bea160>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.826916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.827797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:31.835949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:31.836570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:31.839737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f34bd641-3efe-429c-b2ee-a76a13cc3104 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.085599 May 26 21:23:31.840399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 204/391] 10.222.0.66 () {58 vars in 1169 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:31.848619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:31.849106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:31.853224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a60a5e1d-aba6-4216-b86b-54ac8ef295b9 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8b92550>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:31.937406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a60a5e1d-aba6-4216-b86b-54ac8ef295b9 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088366 May 26 21:23:31.938153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 205/392] 10.222.0.66 () {58 vars in 1154 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:31.949990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b3e95e3d-1deb-4e66-91d9-06aa50acc11d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8bea700>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:32.044921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b3e95e3d-1deb-4e66-91d9-06aa50acc11d tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098768 May 26 21:23:32.045575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 206/393] 10.222.0.66 () {58 vars in 1187 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:32.052785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:32.052785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:32.059363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:32.059898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:32.060907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:32.061535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:32.079759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:32.087751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e7d247db-0e2f-4ecb-ada6-b0b8a7458f18 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.264877 May 26 21:23:32.088249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 188/394] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:31 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:32.098305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7f0c6bd5-9892-4694-9bc5-65d8f8a34398 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] Calling method '.version_select at 0x7f46c8330e50>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:32.136306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:32.143810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e0dc6f90-5e4a-446f-be4e-3c3ee7c146d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1271 microversion: 2.1 time: 0.097217 May 26 21:23:32.148672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 207/395] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:32 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:32.174154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7f0c6bd5-9892-4694-9bc5-65d8f8a34398 tempest-VolumesTestJSON-410956151 tempest-VolumesTestJSON-410956151-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084843 May 26 21:23:32.174725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 189/396] 10.222.0.66 () {58 vars in 1154 bytes} [Thu May 26 21:23:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:33.106478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:33.107099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:33.113315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:33.113803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:33.114577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:33.115019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:33.140827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-46420909-ae91-454c-b73b-7a329a4d3f29 req-47fe91a4-2dd8-4f7d-af0f-4b303789ffdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef5be7de-0f7a-4d3b-b199-b572b6d92292", "tag": "bc09a1e7-c37e-4988-b418-e852e7be84b9"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:33.150499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-46420909-ae91-454c-b73b-7a329a4d3f29 req-47fe91a4-2dd8-4f7d-af0f-4b303789ffdd service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:33.150951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-46420909-ae91-454c-b73b-7a329a4d3f29 req-47fe91a4-2dd8-4f7d-af0f-4b303789ffdd service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:33.163552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-46420909-ae91-454c-b73b-7a329a4d3f29 req-47fe91a4-2dd8-4f7d-af0f-4b303789ffdd service nova] Creating event network-changed:bc09a1e7-c37e-4988-b418-e852e7be84b9 for instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 on hv-cinder-82880 May 26 21:23:33.168775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-46420909-ae91-454c-b73b-7a329a4d3f29 req-47fe91a4-2dd8-4f7d-af0f-4b303789ffdd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034046 May 26 21:23:33.169883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 190/397] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:23:33.176797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:33.176797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:33.183722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:33.184380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:33.186477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:33.186862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:33.387773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:33.395438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-37245630-a670-4280-81c5-60efdf0594cb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.293470 May 26 21:23:33.396015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 208/398] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:33 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:33.447322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:33.457191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-80d6291e-36ee-4b0e-aa8c-6b3f66244c44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.284588 May 26 21:23:33.458168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 191/399] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:33 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:34.412677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:34.413292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:34.419339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:34.419787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:34.420549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:34.421013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:34.474824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:34.476171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:34.483354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:34.483811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:34.484823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:34.485704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:34.490250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:34.601195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:34.608918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-62daf089-998b-4edd-a2cb-bf3976f10671 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.200021 May 26 21:23:34.609504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 209/400] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:34 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:34.645712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:34.653115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1688e26c-b588-4ad2-89bb-954b12f626c4 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.182421 May 26 21:23:34.653686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 192/401] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:34 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:35.625750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:35.626359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:35.632362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:35.632842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:35.633590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:35.634019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:35.669013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:35.669787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:35.676607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:35.677072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:35.677858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:35.678410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:35.808512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:35.815946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fa1c516d-df20-4584-9fc7-8dba0de7e480 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.193998 May 26 21:23:35.817205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 210/402] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:35 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:35.841567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:35.848849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0029d7da-54b7-47da-a346-08849a6d4b63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.183607 May 26 21:23:35.849426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 193/403] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:35 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:36.834137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:36.834754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:36.840973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:36.841427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:36.842189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:36.842632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:36.866075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:36.866599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:36.873196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:36.874267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:36.874410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:36.874774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:37.024026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:37.032017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9f6732f-3a46-49dc-8c1d-3c49389a9d6a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.202328 May 26 21:23:37.032575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 211/404] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:36 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:37.045282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:37.053325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4c851ce1-5fc0-4fb7-a687-582be6306780 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.191781 May 26 21:23:37.053886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 194/405] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:36 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:38.048927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:38.050936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:38.055729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:38.056183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:38.056970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:38.057411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:38.070445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:38.071067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:38.077704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:38.079661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:38.079661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:38.079661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:38.246535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:38.254509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-431df731-3f2e-45eb-82e1-cfa24b5dc97d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.209331 May 26 21:23:38.255006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 212/406] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:38 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:38.268078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:38.276241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4721b90a-a199-48b7-bcb7-45c2fc64ee70 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.210133 May 26 21:23:38.276856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 195/407] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:38 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:39.271810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:39.272424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:39.274616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:39.279651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:39.280364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:39.281158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:39.281599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:39.293760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:39.294439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:39.296307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:39.297051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=6 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:39.302240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:39.302847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:39.303626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:39.304075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:39.486616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:39.494716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a59b0887-0c3c-4488-8d0c-26f7e9023f3a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.227239 May 26 21:23:39.495331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 213/408] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:39 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:39.503339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:39.511489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d0e110b9-4247-4456-8a88-d19ac13e0738 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.221557 May 26 21:23:39.512186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 196/409] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:39 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:40.511545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:40.512191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:40.518197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:40.518651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:40.519449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:40.519890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:40.527652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:40.533213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:40.535239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:40.535691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:40.536458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:40.536936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:40.721201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:40.723405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:40.727762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:40.729504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bdbd8d3b-a757-494e-816b-010b890b336f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.221702 May 26 21:23:40.730088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 214/410] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:40 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:40.735461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c68bc774-b09e-4e49-9ebe-e40e385d6263 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.211550 May 26 21:23:40.738719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 197/411] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:40 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:41.751606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:41.752266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:41.752963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:41.753607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:41.756036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=33 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:41.761151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:41.761628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:41.762372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:41.769041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:41.769495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:41.770260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:41.770697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:41.773950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:41.975754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:41.976154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:41.982078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-12fdeabc-8aab-43b4-b748-6d31fd64534a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.233879 May 26 21:23:41.982669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 198/412] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:41 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:41.984629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c0abe40-8b53-4478-a074-e413f5ab5225 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.242719 May 26 21:23:41.994768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 215/413] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:41 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:43.000429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:43.001080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:43.001944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:43.002578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:43.009386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:43.009741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:43.009852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:43.010275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:43.010767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:43.011183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:43.011590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:43.011731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:43.204622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:43.213297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f800d1ec-4e42-4cdd-b715-2c5426e0861d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.218053 May 26 21:23:43.213974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 199/414] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:42 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:43.217950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:43.229493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9298851b-b0c3-416a-a83c-7e4e40e02433 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.231254 May 26 21:23:43.234354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 216/415] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:42 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:44.230632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:44.231349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:44.237957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:44.238418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:44.239200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:44.239646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:44.248898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:44.249537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:44.256036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:44.256527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:44.257319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:44.257762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:44.434390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:44.442265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6aa118f4-2d78-4e6f-812a-2daefa75824e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.215444 May 26 21:23:44.443768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 200/416] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:44 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:44.459035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:44.466731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4b35c07d-6a7e-45f9-960d-2b801b3b74db tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.221671 May 26 21:23:44.467307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 217/417] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:44 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:45.459870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:45.460472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:45.466911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:45.467356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:45.468106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:45.468533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:45.484874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:45.485616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:45.492025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:45.492555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:45.493505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:45.494046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:45.666533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:45.673451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:45.674717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-401313b3-1f15-4d90-9402-815aa01ae3f3 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.219259 May 26 21:23:45.675838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 201/418] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:45 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:45.680965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3d09011d-cd29-476a-bf05-5bdc431cbafc tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.200362 May 26 21:23:45.681535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 218/419] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:45 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:46.691354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:46.693450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:46.695820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:46.698396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:46.699310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:46.701899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:46.702243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:46.703177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:46.703611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:46.706222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:46.706969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:46.707845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:46.708381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:46.907936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:46.911094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:46.917224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b484e8c6-54fb-4b0c-8986-997dfe3d1035 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.229793 May 26 21:23:46.917799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 202/420] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:46 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:46.919542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9d23adc-5c07-47d4-b8cb-5c8e7e1da219 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.225226 May 26 21:23:46.920024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 219/421] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:46 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:47.293106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1850396756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795338453", "security_groups": [{"name": "tempest-secgroup-smoke-623768988"}], "block_device_mapping_v2": [{"uuid": "a73821fc-2c5b-48e3-a676-5331bf77d690", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0535bc2-e682-4872-ab43-9cc512774e24"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:47.404377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] validate_networks() for [('c0535bc2-e682-4872-ab43-9cc512774e24', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:23:47.485674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-27d307e5-8b28-4450-9335-0ea9d0a7fb4b req-8c822c8f-e005-4ddf-a96c-09a1e8cf2467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5be7de-0f7a-4d3b-b199-b572b6d92292", "name": "network-vif-plugged", "status": "completed", "tag": "bc09a1e7-c37e-4988-b418-e852e7be84b9"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:47.494719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-27d307e5-8b28-4450-9335-0ea9d0a7fb4b req-8c822c8f-e005-4ddf-a96c-09a1e8cf2467 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:47.495163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-27d307e5-8b28-4450-9335-0ea9d0a7fb4b req-8c822c8f-e005-4ddf-a96c-09a1e8cf2467 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:47.507241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-27d307e5-8b28-4450-9335-0ea9d0a7fb4b req-8c822c8f-e005-4ddf-a96c-09a1e8cf2467 service nova] Creating event network-vif-plugged:bc09a1e7-c37e-4988-b418-e852e7be84b9 for instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 on hv-cinder-82880 May 26 21:23:47.512618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-27d307e5-8b28-4450-9335-0ea9d0a7fb4b req-8c822c8f-e005-4ddf-a96c-09a1e8cf2467 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030367 May 26 21:23:47.513115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 220/422] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:23:47.826083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:23:47.826521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:23:47.827093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:23:47.827535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:23:47.827948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:23:47.838408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:47.838876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:47.839721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:47.840161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:47.857290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:23:47.861402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for user b3efa221fe5843cbb3671f4a3512f83b and project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:23:47.919973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:23:47.922091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a73821fc-2c5b-48e3-a676-5331bf77d690',volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:23:47.935777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:47.936253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:47.943410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:47.944005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:47.944868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:47.945378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:48.082167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:48.090369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c0a939a-fc63-4c80-b71a-75f3c48c1fe7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.159399 May 26 21:23:48.090930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 221/423] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:47 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:48.095419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:48.096046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:48.102946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:48.103393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:48.104196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:48.104658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:48.249312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:48.258379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f4ab226b-ab03-4299-a05c-6f440bc79241 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.166462 May 26 21:23:48.259278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 222/424] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:48 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:48.386457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-287076b9-58df-4817-a1e0-e1d79ce4512e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.097117 May 26 21:23:48.387113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 203/425] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:23:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:23:48.397312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eb5232f0-a600-4ec7-8625-29f5b88d571a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:48.397937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eb5232f0-a600-4ec7-8625-29f5b88d571a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:48.454255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb5232f0-a600-4ec7-8625-29f5b88d571a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:48.462526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eb5232f0-a600-4ec7-8625-29f5b88d571a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1095 microversion: 2.1 time: 0.069092 May 26 21:23:48.463418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 223/426] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:48 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:49.108449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:49.109786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:49.117842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.118306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.119306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.120034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.252607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:49.262183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-697ee258-c13c-42cb-8214-f52df5bf7584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1313 microversion: 2.1 time: 0.158111 May 26 21:23:49.263423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 204/427] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:49 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:49.276124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:49.276771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:49.284085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.288238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.288238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.288238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.436076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:49.445938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b8f2e71a-e314-426e-a916-e81db77b160b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.172235 May 26 21:23:49.446959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 224/428] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:49 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:49.482345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:49.482975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:49.492975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.492975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.492975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:49.492975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:49.554845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:49.563666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0923fa73-1dd3-47c5-a076-86a79d5b4d2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1145 microversion: 2.1 time: 0.087654 May 26 21:23:49.564233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 205/429] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:49 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1145 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:50.280445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:50.281117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:50.289535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.289954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.290759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.291239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.467343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:50.468094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:50.474961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.476020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.476910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.477423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.655248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:50.665671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-30975936-4319-44a1-afe8-21f5de4ca012 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1497 microversion: 2.1 time: 0.389861 May 26 21:23:50.676705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 225/430] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:50 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1497 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:50.676705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:50.676705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:50.684502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.685032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.686121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:50.686785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:50.724200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:50.732272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9f191f7b-54a7-41e6-b7c0-fdebf4756b4e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.268869 May 26 21:23:50.732885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 206/431] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:50 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:50.768554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:50.777933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a59fb55a-29d3-4393-8c66-1d5fe252cd14 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1137 microversion: 2.1 time: 0.110026 May 26 21:23:50.778523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 226/432] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:50 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1137 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:51.749414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:51.750152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:51.757114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:51.757632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:51.758461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:51.758959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:51.795571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:51.796335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:51.802403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:51.803281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:51.804119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:51.804668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:51.879744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:51.887939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cbcc34d3-d055-47e5-8293-32d9f2799364 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1137 microversion: 2.1 time: 0.096852 May 26 21:23:51.888526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 227/433] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:51 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1137 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:51.910524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:51.918075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-94abf85e-4bdd-4a8b-acc0-1f598b5ca86f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.172412 May 26 21:23:51.918576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 207/434] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:51 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:52.905329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:52.905883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:52.911828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:52.912279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:52.913154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:52.913592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:52.934981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:52.935627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:52.942104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:52.942551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:52.943314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:52.944439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:52.977140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:52.984605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b16d40e-c6eb-473f-811a-19a2c8065085 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1137 microversion: 2.1 time: 0.083483 May 26 21:23:52.995296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 228/435] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:52 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:53.074202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:53.081715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-81442f03-57e3-4dfa-85ea-32f159fb526c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.150566 May 26 21:23:53.082278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 208/436] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:52 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:54.002302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:54.002913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:54.009590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:54.010072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:54.010865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:54.011308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:54.072165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:54.079598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9f901246-de68-4223-8a4b-16b8dce31c7a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1193 microversion: 2.1 time: 0.081179 May 26 21:23:54.080172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 229/437] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:53 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:54.098157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:54.098778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:54.105260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:54.105708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:54.106465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:54.106904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:54.122019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:54.242023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:54.249491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0b558d6f-4df9-484b-9970-6f9247ffe84d tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.155180 May 26 21:23:54.250041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 209/438] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:54 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:55.097303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:55.098121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:55.104896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.105348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.106116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.106677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.173670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:55.187246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b35adf5a-7b4f-4f02-9924-dfcb566b420e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1201 microversion: 2.1 time: 0.094192 May 26 21:23:55.188795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 230/439] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:55 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1201 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:55.227334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:55.227913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:55.235641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.236100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.239693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.239693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.267629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:55.268349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:55.268468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:23:55.277484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.277957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.278951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.279403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.415146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:55.422633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ff938d42-e945-42cd-aa49-8db4a9b0fd78 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.159423 May 26 21:23:55.423210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 231/440] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:55 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:55.566814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1cc8d63f-54bc-4c70-8b8b-2ef721e9bc2a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 204 len: 0 microversion: 2.1 time: 0.337710 May 26 21:23:55.566814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 210/441] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:23:55 2022] DELETE /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:23:55.574297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:55.575129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:55.582761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.583476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.584974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:55.585901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:55.627043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2020898375", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "networks": [{"uuid": "223f2c8f-b144-4e90-a07c-5cbfe60adb05"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:55.686927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] validate_networks() for [('223f2c8f-b144-4e90-a07c-5cbfe60adb05', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:23:55.790937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:55.798502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b290406b-a112-4ea6-b846-c9ea97db5056 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1503 microversion: 2.1 time: 0.228173 May 26 21:23:55.799076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 232/442] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:55 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:56.073279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:23:56.073697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:23:56.074163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:23:56.074567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:23:56.074973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:23:56.083863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.089405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.089405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.089405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.103236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Getting quotas for project 31ea80663206487ca3ea28c5bb4239f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:23:56.107171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Getting quotas for user f45b8987f3c24cf19de0fa81482c050a and project 31ea80663206487ca3ea28c5bb4239f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:23:56.118869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:23:56.121426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:23:56.204722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:56.205396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:56.211422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.211868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.212661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.213100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.217173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:56.238367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4ad3b2dc-d78b-41e0-9a9e-8afcd5ad1218 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615339 May 26 21:23:56.239770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 211/443] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:23:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:23:56.250437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8b3c4a41-0595-4a64-ba3c-8b73675b01c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:56.251141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8b3c4a41-0595-4a64-ba3c-8b73675b01c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:56.295745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:56.303978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-824c1c15-66c7-434c-8ab7-389cb72c5a43 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1201 microversion: 2.1 time: 0.102500 May 26 21:23:56.308122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 233/444] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:56 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1201 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:56.322103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8b3c4a41-0595-4a64-ba3c-8b73675b01c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:56.328010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8b3c4a41-0595-4a64-ba3c-8b73675b01c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1219 microversion: 2.1 time: 0.081795 May 26 21:23:56.328605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 212/445] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:56 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:56.439383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:56.440260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:56.447037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.447563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.448644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.449049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.601179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:56.608495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-460a70f4-f883-4e0d-a039-2c4c210532a8 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.173079 May 26 21:23:56.609090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 234/446] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:56 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:56.816192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:56.817051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:56.824031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.824477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.825281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:56.825721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:56.961791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:56.969514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-904214a0-2d4c-4cde-8f42-38977648406f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1503 microversion: 2.1 time: 0.157042 May 26 21:23:56.970243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 213/447] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:56 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:57.321436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:57.322044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:57.328093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.328538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.329337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.329773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.345982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:57.346598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:57.353933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.354385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.355155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.355595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.397501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:57.405493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-03d93be0-adb9-45aa-97ea-d2521f666b1e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1211 microversion: 2.1 time: 0.087467 May 26 21:23:57.406075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 235/448] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:57 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:57.424086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:57.431879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1cb9e378-aa28-4654-9808-74052374d728 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1223 microversion: 2.1 time: 0.089659 May 26 21:23:57.432444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 214/449] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:57 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:57.624889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:57.625501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:57.632922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.633703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.634444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.634884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.949185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:57.957064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6856194e-5cfd-4553-8939-95c8aaaf8736 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.336025 May 26 21:23:57.957705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 236/450] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:57 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:57.987407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:57.988074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:57.994925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.995383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:57.996150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:57.996671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.181255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:58.188643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d954b862-ac11-43af-a6ff-6d130c7e5f71 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1503 microversion: 2.1 time: 0.205064 May 26 21:23:58.189236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 215/451] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:57 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1503 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:58.423251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:58.423962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:58.429929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.430371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.431145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.431570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.449141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:58.449766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:58.457024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.457546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.458684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:23:58.458886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.461111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.518929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:58.529482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-906e554c-7699-4d41-a26b-f71b96d70e90 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1211 microversion: 2.1 time: 0.109874 May 26 21:23:58.530600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 237/452] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:58 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:58.562789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:58.570680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33219b9a-fcc3-4c28-9b9b-01bf8441eac6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1271 microversion: 2.1 time: 0.125316 May 26 21:23:58.571876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 216/453] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:58 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:58.973775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:58.974483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:58.981604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.982539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:58.982876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:58.983307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.206379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:59.207004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:59.213864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.214315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.215124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.215557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.250794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:59.259445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95a400c2-d59f-4bd4-bb1f-c95a0a9a62fb tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.289788 May 26 21:23:59.259935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 238/454] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:58 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:59.547633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:59.548333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:59.561816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:59.580287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b20bb2d2-5932-48de-8abc-f5512eba9252 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1503 microversion: 2.1 time: 0.377921 May 26 21:23:59.585311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.585988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.587097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.597803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 217/455] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:59 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1503 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:59.603566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:23:59.604192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:23:59.607591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.625453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.626905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.628475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.629862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:23:59.751892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:59.762712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-488554ba-ccaa-4fbb-81e3-e9a544c20aa1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1271 microversion: 2.1 time: 0.163480 May 26 21:23:59.763311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 218/456] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:59 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1271 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:23:59.887310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:23:59.904735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-345c93c0-c489-481a-98df-8addc5708c2f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.361115 May 26 21:23:59.905900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 239/457] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:23:59 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:23:59.966839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-2422d1a7-84b5-4265-aafd-8c838e765541 req-4c38a739-7dbe-4c6e-b679-509ad2cdb69f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7120fd-a7b6-4fda-b546-794e1162ca96", "tag": "cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:23:59.976553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2422d1a7-84b5-4265-aafd-8c838e765541 req-4c38a739-7dbe-4c6e-b679-509ad2cdb69f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:23:59.976838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2422d1a7-84b5-4265-aafd-8c838e765541 req-4c38a739-7dbe-4c6e-b679-509ad2cdb69f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.001411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-2422d1a7-84b5-4265-aafd-8c838e765541 req-4c38a739-7dbe-4c6e-b679-509ad2cdb69f service nova] Creating event network-changed:cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef for instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 on hv-cinder-82880 May 26 21:24:00.007670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-2422d1a7-84b5-4265-aafd-8c838e765541 req-4c38a739-7dbe-4c6e-b679-509ad2cdb69f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045578 May 26 21:24:00.008273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 219/458] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:00.277601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:00.278137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:00.284874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.285466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.286390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.286919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.608191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:00.608943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:00.622076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.622504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.623302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.623750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.662949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.663403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.663864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lazy-loading 'fault' on Instance uuid ef5be7de-0f7a-4d3b-b199-b572b6d92292 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:24:00.877203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:00.885388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1b2bddad-e545-4a35-9229-fbfb05052e80 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1501 microversion: 2.1 time: 0.611802 May 26 21:24:00.885960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 240/459] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:00 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:00.891182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:00.891792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:00.897815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.898260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.899025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.899457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.923117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:00.933969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cd8e5653-b41c-4d8d-901f-eb9539a58b7e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 200 len: 1303 microversion: 2.1 time: 0.330014 May 26 21:24:00.934354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 220/460] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:00 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 1303 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:00.948316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76a3bb76-820a-4ec4-8f1d-11b204bef46d"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:00.949593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:00.955706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.956169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.956982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:00.957424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:00.981984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] HTTP exception thrown: Cannot 'attach_volume' instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 while it is in vm_state rescued May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Request method failure captured: May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/os-volume_attachments HTTP/1.1 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 74 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9Lywr7t29tQKjqxr7PwohxXejXbDaHBuXWMMi5P_489EhxMYG6tgDPLDaXH3vgSQAhjDcaor4wPUGJxF4vwV2X7tvN8sBzt9VzUPjyF3h23H2PG4Akxi1arIc5wSELD9NsUsSJpW4EVaCl8cZq85cAT-7wiY_413giSCo3sFb4XI0 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:24:00.983725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 23ed95370bfd46e3a1c6946701e66065 May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {"volumeAttachment": {"volumeId": "76a3bb76-820a-4ec4-8f1d-11b204bef46d"}} May 26 21:24:00.985392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Cannot 'attach_volume' instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 while it is in vm_state rescued May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3', 'body': {'volumeAttachment': {'volumeId': '76a3bb76-820a-4ec4-8f1d-11b204bef46d'}}} May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:24:00.986185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 while it is in vm_state rescued May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:00.987447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 while it is in vm_state rescued May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Returning 409 to user: Cannot 'attach_volume' instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 while it is in vm_state rescued {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d18dce81-c7ab-41dd-b4d6-bb0ae5499e53 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041636 May 26 21:24:00.990723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 221/461] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:24:00 2022] POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 26 21:24:00.992171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:00.994715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:00.995435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:01.002619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.003701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.004484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.004952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.006294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c12e41a-befd-4ef9-a5e8-74044ca4892f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1277 microversion: 2.1 time: 0.119247 May 26 21:24:01.016347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 241/462] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:00 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:01.016347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:01.016347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:01.018535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.019096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.019997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.020545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.297843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:01.306592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3f653c27-fc22-48b0-9af0-99e087f8eac8 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.315789 May 26 21:24:01.308105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 222/463] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:00 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:01.323407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-98656b9f-0bc5-4d71-a0ab-4f86168183e1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/action" status: 202 len: 0 microversion: 2.1 time: 0.315186 May 26 21:24:01.324230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 242/464] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:24:01 2022] POST /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:24:01.332770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:01.333391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:01.342059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.342513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.343299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.343762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.588221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:01.598403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5c099d7c-6478-46e6-9093-daeb950350c6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1509 microversion: 2.1 time: 0.269710 May 26 21:24:01.599714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 223/465] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:01 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:01.951581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:01.952278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: ef5be7de-0f7a-4d3b-b199-b572b6d92292] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:01.958618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.959143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.959988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:01.960432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:01.974155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] HTTP exception thrown: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Request method failure captured: May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 HTTP/1.1 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-_FJNxKZlnZL9VXo2OLt7rsl8trtMQXGl1tW-Po72pRjtk951JuTHXogCXMgZKEN0qQpHMv0uLn1oP0tsPSEwG9s0A_zOA2SN7zW3TNB6hAdkSbSvCLl7168-I5ytVQYrymvO55nLNh9RqylUaTayJRgq9Or46wFLpT3QnOV7TYExg May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8c5f36ef25b441e4a4e019765530f370 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesActionsTest-1901869599 May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:24:01.976472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesActionsTest-1901869599 May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8c5f36ef25b441e4a4e019765530f370 May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesActionsTest-1901869599 May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesActionsTest-1901869599-project May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 596dd83622cd4fddbccbb70a98a970bc May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesActionsTest-1901869599-project May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. May 26 21:24:01.977932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'ef5be7de-0f7a-4d3b-b199-b572b6d92292'} May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:24:01.978649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. May 26 21:24:01.979751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:01.980901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Returning 404 to user: Instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:24:01.980901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ab876152-89cf-472e-bf05-be7e2f4f424d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292" status: 404 len: 111 microversion: 2.1 time: 0.030789 May 26 21:24:01.980901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 243/466] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:01 2022] GET /compute/v2.1/servers/ef5be7de-0f7a-4d3b-b199-b572b6d92292 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:24:02.022436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-5edec48d-35bd-4b6e-bb92-6facd8637763 req-1715f3c4-58bc-4595-8ddd-efbaa5464bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef5be7de-0f7a-4d3b-b199-b572b6d92292", "name": "network-vif-deleted", "tag": "bc09a1e7-c37e-4988-b418-e852e7be84b9"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:02.024729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:02.026030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:02.032182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-5edec48d-35bd-4b6e-bb92-6facd8637763 req-1715f3c4-58bc-4595-8ddd-efbaa5464bed service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.032746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-5edec48d-35bd-4b6e-bb92-6facd8637763 req-1715f3c4-58bc-4595-8ddd-efbaa5464bed service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.038622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.045143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.045143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.045143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.051706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-5edec48d-35bd-4b6e-bb92-6facd8637763 req-1715f3c4-58bc-4595-8ddd-efbaa5464bed service nova] Creating event network-vif-deleted:bc09a1e7-c37e-4988-b418-e852e7be84b9 for instance ef5be7de-0f7a-4d3b-b199-b572b6d92292 on hv-cinder-82880 May 26 21:24:02.058810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-5edec48d-35bd-4b6e-bb92-6facd8637763 req-1715f3c4-58bc-4595-8ddd-efbaa5464bed service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039528 May 26 21:24:02.059428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 224/467] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:02.104714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-757547170", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "networks": [{"uuid": "526371f6-9a9a-4438-80fe-61698cbae557"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:02.135744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:02.143931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3f747348-404a-414e-aebe-9f9bd1f9762a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1277 microversion: 2.1 time: 0.123981 May 26 21:24:02.144566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 244/468] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:02 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:02.159057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] validate_networks() for [('526371f6-9a9a-4438-80fe-61698cbae557', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:24:02.323999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:02.324727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:02.331219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.331677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.332461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.332934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.563334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:02.571344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f2c0d982-9b1f-413c-a0dc-88f86b88302e tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.251440 May 26 21:24:02.571905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 245/469] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:02 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:02.617031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:02.617599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:02.623660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.624029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.624818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.625256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.775564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:24:02.776061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:24:02.776669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:24:02.777080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:24:02.777489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:24:02.787016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.787463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.788263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:02.788727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:02.804969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:02.805830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Getting quotas for project 8c5f36ef25b441e4a4e019765530f370. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:24:02.810000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Getting quotas for user 596dd83622cd4fddbccbb70a98a970bc and project 8c5f36ef25b441e4a4e019765530f370. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:24:02.812678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4e3d756c-541e-416c-a5c3-7affa6b6f6c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1509 microversion: 2.1 time: 0.200113 May 26 21:24:02.813240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 246/470] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:02 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:02.821490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:24:02.823858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:24:02.842768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:02.974092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0c1a601c-45d6-4afb-89fb-cf57e35fc402 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874039 May 26 21:24:02.980126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 225/471] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:24:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 21:24:02.985235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1d9e16d-1a2b-41fb-bc1d-f80993cbeee7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:02.985852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1d9e16d-1a2b-41fb-bc1d-f80993cbeee7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:03.042399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1d9e16d-1a2b-41fb-bc1d-f80993cbeee7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:03.049037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1d9e16d-1a2b-41fb-bc1d-f80993cbeee7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1213 microversion: 2.1 time: 0.067644 May 26 21:24:03.049649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 247/472] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:02 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:03.160753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:03.161389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:03.169357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.169813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:03.170580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.171059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:03.309596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:03.318642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c100d8a-d696-49d7-9076-372e01d9986f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.161805 May 26 21:24:03.319213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 226/473] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:03 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:03.588315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:03.589359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:03.610685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.611459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:03.612386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.612965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:03.834990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:03.835623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:03.842105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.842562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:03.843336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:03.843910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.022526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:04.031984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8eaaaa17-84b7-4789-8021-be144b0d1e37 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.448226 May 26 21:24:04.033100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 248/474] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:03 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:04.066911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:04.067529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:04.074412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:04.074862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.075815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:04.076252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.089375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:04.099181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1b40c7d8-4d51-45ff-9489-8f19181bdc1a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1509 microversion: 2.1 time: 0.270802 May 26 21:24:04.100098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 227/475] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:03 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:04.151939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:04.159824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-239b677a-d540-40e8-b5ae-c93eee592521 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1217 microversion: 2.1 time: 0.096824 May 26 21:24:04.160333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 249/476] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:04 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:04.336398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:04.337134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:04.343968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:04.344502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.345401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:04.345917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.350057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:04.538709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:04.546187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fcc9ad08-a0b3-4431-94e1-7fa432d2661f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.214802 May 26 21:24:04.546757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 228/477] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:04 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:04.664176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-3940330e-92ff-4ea6-9605-2247badeaf4f req-95a6c140-ffcc-4d67-bb95-c83909ab9fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "850a6840-7053-4b1a-a335-d19c17bb9011", "tag": "f1247d33-077f-47f9-af05-4f54e79aedb6"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:04.672421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-3940330e-92ff-4ea6-9605-2247badeaf4f req-95a6c140-ffcc-4d67-bb95-c83909ab9fd0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:04.672900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-3940330e-92ff-4ea6-9605-2247badeaf4f req-95a6c140-ffcc-4d67-bb95-c83909ab9fd0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:04.685602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-3940330e-92ff-4ea6-9605-2247badeaf4f req-95a6c140-ffcc-4d67-bb95-c83909ab9fd0 service nova] Creating event network-changed:f1247d33-077f-47f9-af05-4f54e79aedb6 for instance 850a6840-7053-4b1a-a335-d19c17bb9011 on hv-cinder-82880 May 26 21:24:04.690728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-3940330e-92ff-4ea6-9605-2247badeaf4f req-95a6c140-ffcc-4d67-bb95-c83909ab9fd0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030850 May 26 21:24:04.691361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 250/478] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:05.049595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:05.050210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:05.056165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.056639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.057397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.057836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.116831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:05.117544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:05.123880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.124335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.125206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.125649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.129952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:05.233263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:05.241004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c7ff66ed-afb9-45f9-ad99-9360b374c59a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.195143 May 26 21:24:05.241576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 229/479] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:05 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:05.245955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:05.246560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:05.252396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.252868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.253623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.254057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.284568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:05.292229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2dff087d-18d3-4e0a-94d8-f8ec07cca620 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1509 microversion: 2.1 time: 0.179674 May 26 21:24:05.292840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 251/480] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:05 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1509 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:05.316842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:05.324760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b96e55fa-2df8-4ce7-ab69-a8a758cdbd18 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1217 microversion: 2.1 time: 0.082218 May 26 21:24:05.325333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 230/481] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:05 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:05.563324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:05.563944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:05.570254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.570707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:05.571473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:05.571913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.055801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:06.063522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-040bd921-b4b2-4bfd-a8a5-4d5a0b085581 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.504349 May 26 21:24:06.064544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 252/482] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:05 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:06.257806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:06.258426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:06.265449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.269178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.269178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.269178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.309536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:06.310818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:06.317186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.317638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.318413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.319000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.493692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:06.502074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-70b315de-30b9-42e8-8c1d-753dc496d5d0 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.248032 May 26 21:24:06.502949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 231/483] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:06 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:06.508232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:06.508872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:06.516353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.516838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.517606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:06.518034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:06.522578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:06.530455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-02342521-bb2b-4550-a309-07f92ad24fb6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1509 microversion: 2.1 time: 0.224560 May 26 21:24:06.531303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 253/484] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:06 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:06.595197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:06.602838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b4fc84f0-f9c6-42ac-9d1b-e3f68e56ee44 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1209 microversion: 2.1 time: 0.098658 May 26 21:24:06.603404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 232/485] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:06 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:07.081453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:07.082472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:07.088879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.089605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.090568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.091402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.343522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:07.357096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c042fd30-c1e0-4169-b63a-e0259e1eaec5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.274948 May 26 21:24:07.357096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 254/486] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:07 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:07.520719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:07.520719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:07.527404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.527850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.528647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.529086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.547390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:07.548279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:07.556670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.556670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.556670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.556670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.744256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:07.751847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dd228b42-066f-4de1-a2a1-02d877a39011 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.235960 May 26 21:24:07.752430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 233/487] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:07 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:07.757564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:07.759979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:07.764339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.764845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.765610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:07.766059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:07.772411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:07.780816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c07559b-69cc-41be-bc28-7b74f80e6b2b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1515 microversion: 2.1 time: 0.237190 May 26 21:24:07.781492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 255/488] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:07 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:07.841949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:07.849386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-79f3ae90-2a50-473a-bdd0-a0650cfe936a tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1265 microversion: 2.1 time: 0.095922 May 26 21:24:07.851233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 234/489] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:07 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1265 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:08.369302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:08.369923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:08.376142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.376609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.390833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.390833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.510934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:08.518363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9856bd3f-f151-4604-8592-f568b2e7b3c6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.153553 May 26 21:24:08.518927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 256/490] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:08 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:08.774928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:08.775603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:08.782466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.782935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.783680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.784118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.866635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:08.867339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:08.874445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.874920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.875715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:08.876146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:08.929501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:08.934133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b1a86e3-f5b6-4ba2-901e-b80b8b6746da tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.163165 May 26 21:24:08.934796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 235/491] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:08 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:08.945125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:08.952629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a4e5b5de-5c2e-495e-b327-2bcc063a511d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1265 microversion: 2.1 time: 0.090567 May 26 21:24:08.953192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 257/492] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:08 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1265 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:09.535984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:09.536733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:09.545126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.545641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:09.546518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.547066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:09.722381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:09.731089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-64753fcb-b6d1-46e2-9113-55920575d07f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.199012 May 26 21:24:09.731787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 236/493] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:09 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:09.951968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:09.952673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:09.959101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.959962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:09.960845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.961234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:09.980623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:09.981260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:09.988635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.989448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:09.990992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:09.991939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:10.083206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:10.091144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-09e599a9-6efb-46ba-9738-dc0988b4498f tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1265 microversion: 2.1 time: 0.125327 May 26 21:24:10.098042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 237/494] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:09 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:10.145588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:10.154389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5620d9f1-8b91-46ef-b3dc-6ef46f7f7443 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.206852 May 26 21:24:10.155221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 258/495] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:09 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:10.482531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7971b5e1-b9ae-413e-b78f-2d50e84abf33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: .version_select at 0x7f46c82ad310>, body: {"keypair": {"name": "tempest-keypair-168069236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJj6ko+EtT8/OvQW5PYvMIfYkxJHE2CRL42fu4hIoPOiKyYUn0aPOwRCMYC26lOyitazYptNDxba6ZMJdrs+a0/eTceeh/rsnmMKFzCrJ22AwJlL3nb4f88ouuywNmecUQ=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:10.495220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=21 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:10.498756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-7971b5e1-b9ae-413e-b78f-2d50e84abf33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for project 9be77e3090ea4348b5686ebf62749f38. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:24:10.502763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-7971b5e1-b9ae-413e-b78f-2d50e84abf33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for user 23ed95370bfd46e3a1c6946701e66065 and project 9be77e3090ea4348b5686ebf62749f38. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:24:10.609214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7971b5e1-b9ae-413e-b78f-2d50e84abf33 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130707 May 26 21:24:10.611799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 238/496] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:24:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:10.749101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:10.749771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:10.757335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:10.757790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:10.758543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:10.758973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:10.890800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:10.905539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c353e61-f035-47f3-bf90-80845141e9dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.154938 May 26 21:24:10.905539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 259/497] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:10 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:11.108356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:11.109078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:11.115463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.115914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:11.116732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.117176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:11.174836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:11.175382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:11.182249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.182850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:11.184056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.184695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:11.185686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:11.195217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-41258674-7225-45e7-8bbd-fea306087d45 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1273 microversion: 2.1 time: 0.091180 May 26 21:24:11.195884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 239/498] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:11 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:11.341682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:11.349432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0d8e8569-7d85-4314-a851-b267b70074a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.179081 May 26 21:24:11.350044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 260/499] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:11 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:11.918178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:11.918800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:11.924792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.925247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:11.926004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:11.926443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:12.057581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:12.065377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4c498d15-3aa6-41de-89bb-da3eb0c1e11c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.150974 May 26 21:24:12.065961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 240/500] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:11 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:12.212750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:12.213374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:12.216758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=96 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:12.220180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:12.220652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:12.221429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:12.221887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:12.296056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:12.308037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-57e1caa1-b833-4309-b228-c3b31e00d584 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1273 microversion: 2.1 time: 0.099334 May 26 21:24:12.310122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 261/501] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:12 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:12.366746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:12.367362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:12.374251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:12.374926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:12.375745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:12.376191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:12.607064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:12.617396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2c1a1c2f-56d6-448d-9c4c-17b8df14fd91 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.255840 May 26 21:24:12.621771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 241/502] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:12 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:13.079631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:13.083970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:13.087252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:13.092908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.099000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.099000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.099000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.260760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:13.268209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2fecefab-8771-440d-8f57-6556ca66ad6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.190586 May 26 21:24:13.272156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 262/503] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:13 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:13.325567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:13.326491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:13.328812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=6 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:13.334038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.335106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.335972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.336401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.425981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1077045368", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8c11c11-1739-452e-815b-7cbdb8ce7807"}], "security_groups": [{"name": "tempest-securitygroup--1517552989"}], "key_name": "tempest-keypair-168069236", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:13.530431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:13.542120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc40b9f5-0995-4213-9c0d-5bbfdd3d2c8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.220444 May 26 21:24:13.547105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 242/504] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:13 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:13.595859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] validate_networks() for [('b8c11c11-1739-452e-815b-7cbdb8ce7807', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:24:13.634550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:13.635182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:13.650065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.651580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.652924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:13.653804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:13.989551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:13.997153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c138667-3d85-40d1-b080-f88ea81ab8e9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.366493 May 26 21:24:13.997809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 243/505] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:13 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:14.012271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-66bd465f-c913-4bdc-a5ca-ab424a8a9d32 req-195d93ba-06f2-430d-8a63-3e6c901a4e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850a6840-7053-4b1a-a335-d19c17bb9011", "name": "network-vif-plugged", "status": "completed", "tag": "f1247d33-077f-47f9-af05-4f54e79aedb6"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:14.021265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-66bd465f-c913-4bdc-a5ca-ab424a8a9d32 req-195d93ba-06f2-430d-8a63-3e6c901a4e4c service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.025326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-66bd465f-c913-4bdc-a5ca-ab424a8a9d32 req-195d93ba-06f2-430d-8a63-3e6c901a4e4c service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.037130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-66bd465f-c913-4bdc-a5ca-ab424a8a9d32 req-195d93ba-06f2-430d-8a63-3e6c901a4e4c service nova] Creating event network-vif-plugged:f1247d33-077f-47f9-af05-4f54e79aedb6 for instance 850a6840-7053-4b1a-a335-d19c17bb9011 on hv-cinder-82880 May 26 21:24:14.042271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-66bd465f-c913-4bdc-a5ca-ab424a8a9d32 req-195d93ba-06f2-430d-8a63-3e6c901a4e4c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033878 May 26 21:24:14.042873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 244/506] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:14.287260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:14.288707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:14.302415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.303085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.304690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.305233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.722871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:24:14.723357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:24:14.723767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:24:14.724168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:24:14.724836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:24:14.734422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.734892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.735673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.736105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.754036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:24:14.758973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Getting quotas for user 23ed95370bfd46e3a1c6946701e66065 and project 9be77e3090ea4348b5686ebf62749f38. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:24:14.770287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:24:14.773233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:24:14.807245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:14.815225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-69ff55fd-cb70-471c-a79a-2dcbace9e843 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.532884 May 26 21:24:14.828064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 245/507] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:14 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:14.832933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:14.833549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:14.841508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.841963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.842723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:14.843159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:14.858443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:14.899994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [85b062b2-a9f6-4c7c-a99b-f3f75ce4bbd6] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:24:15.029723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:15.037976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66d21ffa-1e80-4985-ba0b-42adcac5b99e tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.208349 May 26 21:24:15.038547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 246/508] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:14 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:15.042909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:15.043516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:15.049686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:15.050131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:15.051001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:15.051462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:15.239452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:15.247265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-40d4131d-a652-4fd7-99bf-8c69b61f5171 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.207682 May 26 21:24:15.247750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 247/509] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:15 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:15.252162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-3f5fdcaa-d266-49d4-ab67-4354515a7d41 req-9b8b6620-4d05-4a6e-9aae-99beff62bf8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cd4333-b73f-4e7b-bd84-c562b151113d", "tag": "e566c358-7e3e-4be7-8252-ccc7f97b5fe3"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:15.259873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3f5fdcaa-d266-49d4-ab67-4354515a7d41 req-9b8b6620-4d05-4a6e-9aae-99beff62bf8f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:15.260315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3f5fdcaa-d266-49d4-ab67-4354515a7d41 req-9b8b6620-4d05-4a6e-9aae-99beff62bf8f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:15.271139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-3f5fdcaa-d266-49d4-ab67-4354515a7d41 req-9b8b6620-4d05-4a6e-9aae-99beff62bf8f service nova] Creating event network-changed:e566c358-7e3e-4be7-8252-ccc7f97b5fe3 for instance 26cd4333-b73f-4e7b-bd84-c562b151113d on hv-cinder-82880 May 26 21:24:15.276313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-3f5fdcaa-d266-49d4-ab67-4354515a7d41 req-9b8b6620-4d05-4a6e-9aae-99beff62bf8f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027381 May 26 21:24:15.281691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 248/510] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:15.834259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:15.835468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:15.841640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:15.842084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:15.842830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:15.843259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:15.908247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [85b062b2-a9f6-4c7c-a99b-f3f75ce4bbd6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 37376. May 26 21:24:15.922560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e324183e-bf28-4524-986e-0ece7f631650 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.502869 May 26 21:24:15.923218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 263/511] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:24:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 2505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 21:24:15.933366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2f4ba9b8-a7e1-4bc8-ad3e-8353e86af1c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:15.933988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2f4ba9b8-a7e1-4bc8-ad3e-8353e86af1c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:15.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2f4ba9b8-a7e1-4bc8-ad3e-8353e86af1c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:15.999207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:16.003102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2f4ba9b8-a7e1-4bc8-ad3e-8353e86af1c5 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1245 microversion: 2.1 time: 0.073379 May 26 21:24:16.003802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 264/512] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:15 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:16.006540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c802d282-71cb-4a76-8296-6f6337628b4c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.177011 May 26 21:24:16.015798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 249/513] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:15 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:16.055155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:16.055804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:16.062744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:16.063190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:16.063953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:16.064392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:16.197821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:16.205255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-47f7cf29-6edc-4ab2-ad40-e9f70b622c63 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.154196 May 26 21:24:16.205820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 265/514] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:16 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:16.264019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:16.264673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:16.270784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:16.271235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:16.272633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:16.273066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:16.404370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:16.412299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-640fc52f-0d11-4b65-9483-1e2f118ab779 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.152066 May 26 21:24:16.416612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 250/515] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:16 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:17.020358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:17.021011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:17.022891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:17.023511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:17.027573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.028027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.028905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.029349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.029934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.030648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.031412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.031858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.101093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:17.108506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-06443009-2ee4-4198-973f-2ec4307f7804 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1249 microversion: 2.1 time: 0.091976 May 26 21:24:17.109107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 266/516] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:17 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:17.183202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:17.190486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-14febdd3-820a-4288-bb10-f0101687aebc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.171401 May 26 21:24:17.191052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 251/517] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:17 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:17.222462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:17.223073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:17.229173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.229626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.230385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.230822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.359008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:17.367011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78a812e7-81b0-4b58-b3b0-c7d8da397c46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.148405 May 26 21:24:17.367571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 267/518] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:17 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:17.429797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:17.430402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:17.436851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.437307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.438072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:17.438509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:17.576196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:17.583377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aaef6aef-a758-4a1f-90c2-016c7b359e65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.157857 May 26 21:24:17.583953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 252/519] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:17 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:18.125982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:18.126588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:18.133194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.133637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.134407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.134838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.195070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:18.202433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7da264ec-f672-4e66-8bf4-638cd219f7c1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1249 microversion: 2.1 time: 0.080345 May 26 21:24:18.202991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 268/520] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:18 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:18.207151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:18.207764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:18.214310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.214758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.215524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.215964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.342843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:18.350376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-377ed764-a2fd-47f6-a6de-4c5ebed01815 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.147057 May 26 21:24:18.350944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 253/521] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:18 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:18.384095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:18.384665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:18.390967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.391416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.392176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.392636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.407415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:18.523658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:18.531229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-282bcdcf-9666-4f7c-9eb4-d37582b72cf8 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.151641 May 26 21:24:18.531779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 269/522] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:18 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:18.601359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:18.602121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:18.609669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.610495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.611288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:18.611732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:18.827813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:18.835913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66e3441d-ac09-4b81-96de-add9876b1821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.239143 May 26 21:24:18.836489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 254/523] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:18 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:19.218107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:19.218724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:19.225329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.225781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.226572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.227006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.289176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:19.296612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-daae1a21-94e6-4563-b408-54a2ac9d85d7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.082324 May 26 21:24:19.297185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 270/524] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:19 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:19.367043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:19.367649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:19.373635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.374093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.374856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.375498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.505214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:19.513430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eda948b6-d287-46f7-9e42-94efc2543943 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.150275 May 26 21:24:19.514042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 255/525] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:19 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:19.527242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-b6c57b3c-0803-48c6-89e5-87182f4c350b req-e7b3fe5e-1b31-4bca-8584-d22f4204b544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7120fd-a7b6-4fda-b546-794e1162ca96", "name": "network-vif-plugged", "status": "completed", "tag": "cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:19.536034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b6c57b3c-0803-48c6-89e5-87182f4c350b req-e7b3fe5e-1b31-4bca-8584-d22f4204b544 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.536485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b6c57b3c-0803-48c6-89e5-87182f4c350b req-e7b3fe5e-1b31-4bca-8584-d22f4204b544 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.548535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-b6c57b3c-0803-48c6-89e5-87182f4c350b req-e7b3fe5e-1b31-4bca-8584-d22f4204b544 service nova] Creating event network-vif-plugged:cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef for instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 on hv-cinder-82880 May 26 21:24:19.549366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:19.550091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:19.553777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-b6c57b3c-0803-48c6-89e5-87182f4c350b req-e7b3fe5e-1b31-4bca-8584-d22f4204b544 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034140 May 26 21:24:19.554566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 271/526] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:19.557424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.557882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.558598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.559028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.696254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:19.704412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5daa86a-cb63-4094-8818-8224b19a1860 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.158836 May 26 21:24:19.705020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 256/527] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:19 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:19.853520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:19.854171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:19.860379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.860871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.861636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:19.862107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:19.991877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:19.999259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5100d98d-d116-40b0-8cf7-230e09be587d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.150139 May 26 21:24:19.999824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 272/528] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:19 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:20.314198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:20.314816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:20.321427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.321878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.322636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.323075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.386658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:20.394166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ac15d6f-8f0b-47ea-96f1-4c09b52d54b9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.083888 May 26 21:24:20.394724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 257/529] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:20 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:20.531139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:20.531771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:20.538421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.538873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.539658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.540089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.672134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:20.679877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cb4f0f0f-b596-4b28-8780-ca3c696fc3c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.152788 May 26 21:24:20.680455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 273/530] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:20 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:20.721562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:20.722215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:20.724175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:20.730234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.730685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.731450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:20.731883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:20.858767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:20.866276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-90846217-8b24-4a57-aecf-4ceea6d518aa tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.148706 May 26 21:24:20.866841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 258/531] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:20 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:21.016734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:21.017352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:21.024316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.028747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.028747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.028747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.161358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:21.168870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b19e976-09b6-4138-8b1e-7b9f43e1369d tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.156178 May 26 21:24:21.169429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 274/532] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:21 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:21.411877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:21.412466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:21.418583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.419038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.419803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.420243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.481651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:21.488980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3f63c4eb-f57a-49a2-b1c4-d391dbfc1c29 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.081012 May 26 21:24:21.489533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 259/533] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:21 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:21.697952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:21.698578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:21.705291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.705744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.706525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.706963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.854431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:21.861864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-918568f9-30ce-4925-b8a2-f7c7b948bd66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.168626 May 26 21:24:21.862440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 275/534] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:21 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:21.883255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:21.883871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:21.890517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.890970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:21.891735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:21.892177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.027050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:22.035085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6eeed8ef-25d8-42cd-803a-8860140f5b0d tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.156306 May 26 21:24:22.035665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 260/535] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:21 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:22.186132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:22.186732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:22.192987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.193429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.194231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.194663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.328323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:22.336484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1e52625d-dd05-477a-8e68-e8f2dcaec655 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.154193 May 26 21:24:22.337090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 276/536] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:22 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:22.505091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:22.505696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:22.512319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.512813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.513588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.514028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.577285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:22.585748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-105003d4-e787-45a1-ab85-ec01f6a1ca19 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.083553 May 26 21:24:22.586138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 261/537] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:22 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:22.879381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:22.879903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:22.886645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.887098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:22.887860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:22.888297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.026291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:23.034381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3d4ea777-658b-4cb3-9888-9c95a7094a57 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.158929 May 26 21:24:23.034969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 277/538] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:22 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:23.052836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:23.055343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:23.060906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.061357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.062129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.062561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.196081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:23.203465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a562d5bd-6774-4066-ad4f-bb28bf3cf1ac tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.154708 May 26 21:24:23.204038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 262/539] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:23 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:23.354694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:23.355348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:23.361911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.362357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.363130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.363570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.497282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:23.504719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e75bdf4-1822-4afa-aab0-1b7b38e2508c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.153877 May 26 21:24:23.505287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 278/540] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:23 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:23.602193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:23.602810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:23.608920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.609373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.610135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:23.610577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:23.672553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:23.674784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:23.681315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0204c094-8f46-4104-bf14-aca0fa9c7713 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.082989 May 26 21:24:23.681897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 263/541] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:23 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:24.051284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:24.051963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:24.058618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.059062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.059814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.060244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.187116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:24.194622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-10f7daef-80c1-40c0-a3cb-498b841e0599 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1319 microversion: 2.1 time: 0.147277 May 26 21:24:24.195205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 279/542] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:24 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:24.220301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:24.220943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:24.228215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.228772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.229538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.229980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.399750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:24.407576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-495c9d22-65f8-47a6-b8d2-7d52ab15e173 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.191394 May 26 21:24:24.408187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 264/543] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:24 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:24.522616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:24.523218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:24.529417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.529859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.530873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.531303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.662730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:24.670408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70b8f966-6e08-447a-8b22-8c4a7608cfb5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.152353 May 26 21:24:24.671003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 280/544] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:24 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:24.698180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:24.698785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:24.704788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.705231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.705978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:24.706406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:24.767207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:24.775337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-10fd9394-56d1-4cdc-a380-caae0072d9e0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1297 microversion: 2.1 time: 0.081569 May 26 21:24:24.775894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 265/545] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:24 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:25.211497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:25.212101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:25.214105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:25.218888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.219335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.220090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.220522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.347425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:25.355475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-643d9a61-3f72-4802-af17-3016bddf4e9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1507 microversion: 2.1 time: 0.147906 May 26 21:24:25.356043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 281/546] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:25 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:25.424740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:25.425364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:25.432571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.433113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.433818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.434255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.601960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:25.619427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d0e4f4a8-2473-4168-a3b8-22a760ee4548 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.198328 May 26 21:24:25.623108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 266/547] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:25 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:25.687370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:25.687983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:25.695291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.695291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.695590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.695939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.796194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:25.797464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:25.808864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.808864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.808864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:25.808864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:25.920801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:25.923829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f2c32988-5756-4cf6-8868-a4d020fc9bd7 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1305 microversion: 2.1 time: 0.133541 May 26 21:24:25.924396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 267/548] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:25 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1305 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:25.955593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:25.963528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fe5ae99c-581f-4ff6-98d5-f5483479b672 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.280070 May 26 21:24:25.964100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 282/549] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:25 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:26.639112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:26.639808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:26.647503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.648090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:26.649007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.649580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:26.845091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:26.853433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e0c4ae3f-df95-494c-9938-c736757812ca tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.218460 May 26 21:24:26.854100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 268/550] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:26 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:26.947116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:26.948104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:26.950611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=8 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:26.956264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.956740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:26.957520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.957963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:26.981702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:26.982634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:26.990389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.991742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:26.992684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:26.993586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:27.037142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:27.046071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a9135869-9dc5-4ff6-b2f0-d0a6654560a0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1303 microversion: 2.1 time: 0.103918 May 26 21:24:27.047037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 283/551] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:26 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:27.141975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:27.150377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b19f581b-373b-4773-853e-240505b6fa2a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.172981 May 26 21:24:27.150944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 269/552] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:26 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:27.871204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:27.871718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:27.877974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:27.878422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:27.879218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:27.879650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:28.012140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:28.019700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e4456400-fab4-4638-a4a8-387143ddad69 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.153083 May 26 21:24:28.020262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 284/553] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:27 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:28.064965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:28.065732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:28.068095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=98 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:28.073628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:28.074079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:28.074851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:28.075289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:28.167143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:28.167843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:28.174732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:28.175278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:28.176171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:28.176650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:28.210442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:28.218101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ac06822-9cdd-4574-8f7f-b572bc01b3e4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.157296 May 26 21:24:28.218875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 270/554] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:28 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:28.314382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:28.322203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-993032db-5ba0-46fc-acb5-e003715a843c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.158883 May 26 21:24:28.322932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 285/555] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:28 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:29.036919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:29.037998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:29.044290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.044784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.045544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.045984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.176894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:29.185053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f518279-e2fe-4683-ae40-c0740cf821fd tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.152206 May 26 21:24:29.186484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 271/556] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:29 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:29.235410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:29.236023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:29.242241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.242692 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.243456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.243891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.339399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:29.340017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:29.346170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.346657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.347437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:29.347875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:29.380787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:29.384605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:29.388985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4d514b34-e406-428f-8ccb-256bd77c9726 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.157443 May 26 21:24:29.389805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 286/557] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:29 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:29.484379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:29.491884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f933fb1-2eb1-4c06-968e-6d92fceed1bd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.156389 May 26 21:24:29.499260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 272/558] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:29 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:30.202413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:30.203020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:30.210110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.210562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.211322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.211758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.343699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:30.351787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae94a1e8-8405-438f-8dc0-44620dc2dc8b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.153272 May 26 21:24:30.352447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 287/559] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:30 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:30.406061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:30.406766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:30.414903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.415353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.416344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.416820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.510295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:30.511154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:30.523327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.524023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.524835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:30.525273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:30.577219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:30.585560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b13f8fad-5a58-446a-9583-6d76241b234f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.183797 May 26 21:24:30.586133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 273/560] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:30 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:30.668783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:30.676657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a1198d9d-2010-4b12-9de2-fab6cb5d3fdc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.171576 May 26 21:24:30.677268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 288/561] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:30 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:31.368326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:31.369076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:31.375406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.375857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.376738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.377185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.603508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:31.604853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:31.611107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.611663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.612514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.613213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.649209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:31.657250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6b987bf4-1a69-4fa7-a368-1e8888717e57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.293530 May 26 21:24:31.657932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 274/562] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:31 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:31.694709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:31.696072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:31.703191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.704116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.705166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:31.705811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:31.868013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:31.876478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1b8a889b-323e-4d78-8744-33a72610fba0 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.277365 May 26 21:24:31.877108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 289/563] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:31 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:31.929278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:31.937062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3059c912-32d3-4313-8604-8fed33410478 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1266 microversion: 2.1 time: 0.246971 May 26 21:24:31.937688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 275/564] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:31 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1266 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:32.249594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-6f2ccabd-6753-4ca6-b499-4003bdd6854e req-adaf0bbd-a81b-4867-be4a-fcbc35a49fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7353f7c0-bddc-4c45-84b7-534af0b2fed7", "tag": "b7bb9cad-415f-46ce-a0b3-0822cbd396cb"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:32.259903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-6f2ccabd-6753-4ca6-b499-4003bdd6854e req-adaf0bbd-a81b-4867-be4a-fcbc35a49fc7 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.260529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-6f2ccabd-6753-4ca6-b499-4003bdd6854e req-adaf0bbd-a81b-4867-be4a-fcbc35a49fc7 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.285659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-6f2ccabd-6753-4ca6-b499-4003bdd6854e req-adaf0bbd-a81b-4867-be4a-fcbc35a49fc7 service nova] Creating event network-changed:b7bb9cad-415f-46ce-a0b3-0822cbd396cb for instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 on hv-cinder-82880 May 26 21:24:32.290992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-6f2ccabd-6753-4ca6-b499-4003bdd6854e req-adaf0bbd-a81b-4867-be4a-fcbc35a49fc7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045639 May 26 21:24:32.292079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 290/565] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:24:32.675330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:32.675927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:32.683352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.683795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.684562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.685033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.895596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:32.897890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:32.906482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.907813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.909192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.911126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.925417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:32.935649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c9aed828-ea81-49d1-aa77-cd0ad6f1ca66 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.264087 May 26 21:24:32.946851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 276/566] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:32 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:32.954240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:32.954874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:32.961656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.962184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:32.967528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:32.967528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:33.219884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:33.229258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-64251ca7-a7f8-4364-ba27-57a733e3587a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.339541 May 26 21:24:33.230101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 291/567] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:32 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:33.235349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-2f22b92e-778f-4699-8825-60f84a9f4345 req-fcc03747-8eaf-4025-9b40-36240cc96c04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cd4333-b73f-4e7b-bd84-c562b151113d", "name": "network-vif-plugged", "status": "completed", "tag": "e566c358-7e3e-4be7-8252-ccc7f97b5fe3"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:33.244474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f22b92e-778f-4699-8825-60f84a9f4345 req-fcc03747-8eaf-4025-9b40-36240cc96c04 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:33.245034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f22b92e-778f-4699-8825-60f84a9f4345 req-fcc03747-8eaf-4025-9b40-36240cc96c04 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:33.256210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-2f22b92e-778f-4699-8825-60f84a9f4345 req-fcc03747-8eaf-4025-9b40-36240cc96c04 service nova] Creating event network-vif-plugged:e566c358-7e3e-4be7-8252-ccc7f97b5fe3 for instance 26cd4333-b73f-4e7b-bd84-c562b151113d on hv-cinder-82880 May 26 21:24:33.257819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:33.261399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-2f22b92e-778f-4699-8825-60f84a9f4345 req-fcc03747-8eaf-4025-9b40-36240cc96c04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 May 26 21:24:33.261917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 292/568] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:33.265881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-74b41895-415a-48f7-9e09-8d0d34e25b53 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1454 microversion: 2.1 time: 0.315734 May 26 21:24:33.266473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 277/569] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:32 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1454 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:33.285041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:33.286196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:33.294923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:33.295911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:33.296712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:33.297146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:33.476316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:33.486956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7e93337e-1f6e-4bdf-b2bb-0f27ac753c17 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1454 microversion: 2.1 time: 0.207464 May 26 21:24:33.487536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 293/570] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:33 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1454 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:33.952462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:33.953147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:33.960030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:33.960491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:33.961329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:33.961798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:34.096535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:34.104714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dd509fe2-d14e-4fc4-956d-9fc6a45199bb tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.156045 May 26 21:24:34.105451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 278/571] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:33 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:34.247084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:34.247978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:34.254290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:34.255068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:34.255867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:34.256309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:34.393546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:34.401224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5cf24d05-8457-4cf5-8d5e-952cafadf777 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.159144 May 26 21:24:34.401803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 294/572] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:34 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:35.121676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:35.122244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:35.129016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:35.129460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:35.130228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:35.130663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:35.271132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:35.279285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31604c69-4a91-4901-908f-42eaaf655a40 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.161469 May 26 21:24:35.279853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 279/573] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:35 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:35.417862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:35.418468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:35.424803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:35.425251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:35.426011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:35.426445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:35.599767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:35.608857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-42697dfd-46bb-4147-ade8-b67c07e3600c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.194564 May 26 21:24:35.621849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 295/574] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:35 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:35.623981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-ae7ca9dd-3d51-41d9-9278-011a5ef661c8 req-ab168292-2bc4-4af8-b9a7-9666bf5856ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c7120fd-a7b6-4fda-b546-794e1162ca96", "tag": "cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:35.632234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ae7ca9dd-3d51-41d9-9278-011a5ef661c8 req-ab168292-2bc4-4af8-b9a7-9666bf5856ee service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:35.633276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ae7ca9dd-3d51-41d9-9278-011a5ef661c8 req-ab168292-2bc4-4af8-b9a7-9666bf5856ee service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:35.644377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-ae7ca9dd-3d51-41d9-9278-011a5ef661c8 req-ab168292-2bc4-4af8-b9a7-9666bf5856ee service nova] Creating event network-changed:cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef for instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 on hv-cinder-82880 May 26 21:24:35.649778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-ae7ca9dd-3d51-41d9-9278-011a5ef661c8 req-ab168292-2bc4-4af8-b9a7-9666bf5856ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029668 May 26 21:24:35.650398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 280/575] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:36.296171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:36.296820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:36.303016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:36.303469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:36.304235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:36.304700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:36.447067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:36.454582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0d1052bf-295e-4d3e-ae36-ba1f632aa714 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.162292 May 26 21:24:36.455139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 296/576] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:36 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:36.629678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:36.630425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:36.637485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:36.637934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:36.638697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:36.642761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:36.643704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:36.777174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:36.785017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-857df524-0af9-445f-9b3b-0a951258329b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.161153 May 26 21:24:36.785697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 281/577] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:36 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:37.472027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:37.472663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:37.478804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:37.479252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:37.480009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:37.480440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:37.624717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:37.632375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-25d3f235-ff72-4bc3-810c-cd4ccd0712fe tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.164209 May 26 21:24:37.633733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 297/578] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:37 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:37.802997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:37.803657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:37.810720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:37.811166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:37.811936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:37.812355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:37.938482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:37.946443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-892e1dc5-c028-470e-bd2a-0b7a559ec714 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.148334 May 26 21:24:37.947004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 282/579] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:37 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:38.659937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:38.660470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:38.667225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:38.667668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:38.668431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:38.668900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:38.800923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:38.808749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-564c71b8-6a60-44b8-abaa-6581d8c31d46 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.152728 May 26 21:24:38.809334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 298/580] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:38 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:38.963733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:38.964264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:38.970821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:38.971260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:38.972010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:38.972440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:39.101884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:39.111182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-899cd700-6200-4162-87b2-5516e09e2ad3 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.151717 May 26 21:24:39.111950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 283/581] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:38 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:39.825290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:39.825898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:39.831841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:39.832283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:39.833054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:39.833483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:39.960277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:39.968119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-465bcedb-223a-43ec-b341-20906d1d4031 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.146653 May 26 21:24:39.968699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 299/582] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:39 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:40.131767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:40.132391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:40.139341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:40.139797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:40.140570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:40.141041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:40.272763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:40.281069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a3617d9-abcd-49e4-ab6d-18bf4ac77b63 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.153307 May 26 21:24:40.281638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 284/583] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:40 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:40.985239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:40.985780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:40.992737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:40.993186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:40.993967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:40.994397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:41.123938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:41.131384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-260accb0-2842-4b0d-8897-eb5e14be516c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.149994 May 26 21:24:41.131956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 300/584] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:40 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:41.297404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:41.298011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:41.305253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:41.305699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:41.306454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:41.306883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:41.436987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:41.444250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-35bd3c1e-fdad-4405-9a36-fc6c5e705273 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.150938 May 26 21:24:41.444841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 285/585] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:41 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:42.147833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:42.149046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:42.155004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:42.155713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:42.156472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:42.156901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:42.292016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:42.299583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-618349f1-e4ad-4842-a58c-0c616e65b203 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.155549 May 26 21:24:42.300165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 301/586] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:42 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:42.461420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:42.461961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:42.468482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:42.468972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:42.469737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:42.470204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:42.604192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:42.611504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-120f6f44-74c9-4a80-a7d7-413325eccaf6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.154188 May 26 21:24:42.612061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 286/587] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:42 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:43.316410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:43.316980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:43.318973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:43.323793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:43.324243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:43.325037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:43.325480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:43.454842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:43.462639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e5989d4-e138-4edb-a127-d10c550dd7c7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.150136 May 26 21:24:43.463234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 302/588] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:43 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:43.628644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:43.632911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:43.635790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:43.636232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:43.637018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:43.637449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:43.768628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:43.778609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b9357514-01aa-4f04-b1b6-6767ccfaec8b tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.153756 May 26 21:24:43.779189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 287/589] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:43 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:44.481172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:44.481814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:44.487843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:44.488296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:44.489282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:44.489727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:44.674558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:44.682520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-31ecd952-c2f0-417c-b599-5f146dabf7b7 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.205871 May 26 21:24:44.683113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 303/590] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:44 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:44.795789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:44.801847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:44.803276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:44.803734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:44.805220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:44.805681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:44.972092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:44.980139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b1906b7f-aa99-41cf-8b40-1d16cf72ca21 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.188251 May 26 21:24:44.980734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 288/591] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:44 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:45.706714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:45.707416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:45.715654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:45.716115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:45.716924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:45.717513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:45.857237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:45.859402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:45.868076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-47af2e4d-b36e-4940-959b-5ad156ed8485 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.165744 May 26 21:24:45.877539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 304/592] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:45 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:45.997622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:45.998252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:46.005088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:46.005542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:46.006317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:46.006773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:46.169519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:46.175702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fd0022d4-0122-420f-9a02-91413bae41f4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.182045 May 26 21:24:46.185753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 289/593] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:45 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:46.306174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-b00545e4-3805-4e98-956e-9e2718157579 req-a4d2297a-9135-47ee-a85d-ba975ef4d244 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7353f7c0-bddc-4c45-84b7-534af0b2fed7", "name": "network-vif-plugged", "status": "completed", "tag": "b7bb9cad-415f-46ce-a0b3-0822cbd396cb"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:46.315149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b00545e4-3805-4e98-956e-9e2718157579 req-a4d2297a-9135-47ee-a85d-ba975ef4d244 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:46.315592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b00545e4-3805-4e98-956e-9e2718157579 req-a4d2297a-9135-47ee-a85d-ba975ef4d244 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:46.329345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-b00545e4-3805-4e98-956e-9e2718157579 req-a4d2297a-9135-47ee-a85d-ba975ef4d244 service nova] Creating event network-vif-plugged:b7bb9cad-415f-46ce-a0b3-0822cbd396cb for instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 on hv-cinder-82880 May 26 21:24:46.334378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-b00545e4-3805-4e98-956e-9e2718157579 req-a4d2297a-9135-47ee-a85d-ba975ef4d244 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 May 26 21:24:46.335036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 305/594] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:46.886068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:46.886718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:46.893125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:46.893571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:46.894340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:46.894884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:47.026287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:47.034214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-be2b7a5a-7540-46a6-a7bd-5ee621b1d55c tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1313 microversion: 2.1 time: 0.152674 May 26 21:24:47.034781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 290/595] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:46 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:47.195777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:47.195777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:47.202515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:47.203163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:47.204051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:47.204542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:47.366746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:47.374629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ea340d9-f82f-4ab9-b151-f5f0f5c07f7a tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.184819 May 26 21:24:47.375204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 306/596] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:47 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:48.051160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:48.051975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:48.059607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:48.060055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:48.060901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:48.061494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:48.202486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:48.211145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4941b3f9-d636-436b-8bd7-271f37ec0739 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1497 microversion: 2.1 time: 0.163678 May 26 21:24:48.211722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 291/597] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:48 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:48.392193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:48.392840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:48.400344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:48.400828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:48.401607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:48.402046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:48.581044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:48.589965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-93fea8b2-5761-4024-88ca-f25a2829245e tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.201720 May 26 21:24:48.590543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 307/598] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:48 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:49.037857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:49.038365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:49.044528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.044976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.045752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.046195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.071662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:24:49.402055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-312fb752-6c0b-4e46-a92c-087d2bc656a1 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "DELETE /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 204 len: 0 microversion: 2.1 time: 0.367815 May 26 21:24:49.402871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 292/599] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:24:49 2022] DELETE /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:24:49.415509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:49.416264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:49.422829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.423285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.424067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.424506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.584032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:49.592356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f9e765ac-47ec-4d9a-acae-fe1a3e89dc00 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1503 microversion: 2.1 time: 0.181307 May 26 21:24:49.592975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 308/600] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:49 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:49.608290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:49.609033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:49.615669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.616118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.616962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:49.617397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:49.777723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:49.785843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eeeee064-c252-4137-a628-a61769550a27 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.181952 May 26 21:24:49.790604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 293/601] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:49 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:50.610470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:50.611107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:50.618316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.618316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.619050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.619468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.765167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:50.774988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f49143af-cb3f-4021-8b8c-ebc9fd66adf0 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1503 microversion: 2.1 time: 0.168259 May 26 21:24:50.775781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 309/602] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:50 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:50.805056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:50.805721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:50.812678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.813139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.813914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:50.814355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:50.956937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:50.964940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a13d77f0-e166-48dd-b756-2f8ed68998a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1371 microversion: 2.1 time: 0.164679 May 26 21:24:50.965512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 294/603] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:50 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:51.793664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:51.794283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:51.800270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:51.800759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:51.801517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:51.801956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:51.939226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:51.946905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b385a3cc-9530-4f55-a658-622fc9175a57 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1503 microversion: 2.1 time: 0.157209 May 26 21:24:51.947555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 310/604] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:51 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:51.983785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:51.983785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:51.990926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:51.991375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:51.992168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:51.992684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:52.125283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:52.132695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-217d3a82-9ec8-43ed-bf1b-f5acfc981599 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1565 microversion: 2.1 time: 0.153721 May 26 21:24:52.133273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 295/605] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:51 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1565 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:52.149561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:52.150058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:52.156209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:52.156688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:52.157450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:52.157897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:52.237568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e561294b-814e-48b2-ba94-0ff403262745 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092343 May 26 21:24:52.238157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 311/606] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:24:52 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:52.963912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:52.964855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:52.970846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:52.971421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:52.972208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:52.972669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:52.976866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:24:53.279644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:53.287396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b3b4cb6a-a3ec-47e4-8e65-b6362bb403e6 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1503 microversion: 2.1 time: 0.327966 May 26 21:24:53.287957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 296/607] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:52 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:24:53.576505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-047cdef1-5bf6-4289-a78e-4b2889b9bb39 req-fda361d4-608d-4ba3-ad54-d6e751768401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cd4333-b73f-4e7b-bd84-c562b151113d", "name": "network-vif-deleted", "tag": "e566c358-7e3e-4be7-8252-ccc7f97b5fe3"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:53.587797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-047cdef1-5bf6-4289-a78e-4b2889b9bb39 req-fda361d4-608d-4ba3-ad54-d6e751768401 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:53.588275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-047cdef1-5bf6-4289-a78e-4b2889b9bb39 req-fda361d4-608d-4ba3-ad54-d6e751768401 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:53.604145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-047cdef1-5bf6-4289-a78e-4b2889b9bb39 req-fda361d4-608d-4ba3-ad54-d6e751768401 service nova] Creating event network-vif-deleted:e566c358-7e3e-4be7-8252-ccc7f97b5fe3 for instance 26cd4333-b73f-4e7b-bd84-c562b151113d on hv-cinder-82880 May 26 21:24:53.610380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-047cdef1-5bf6-4289-a78e-4b2889b9bb39 req-fda361d4-608d-4ba3-ad54-d6e751768401 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038522 May 26 21:24:53.611144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 312/608] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:54.304044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:54.305455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:54.312391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:54.315729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:54.315729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:54.315729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:54.350218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:54.350218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:54.350218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lazy-loading 'fault' on Instance uuid 26cd4333-b73f-4e7b-bd84-c562b151113d {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:24:54.391939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596dd83622cd4fddbccbb70a98a970bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5f36ef25b441e4a4e019765530f370', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:24:54.400733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2ef67754-8ef0-48c3-8a67-a2eacd7e855b tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 200 len: 1303 microversion: 2.1 time: 0.100479 May 26 21:24:54.401546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 297/609] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:54 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:24:55.420860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:24:55.421496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] [instance: 26cd4333-b73f-4e7b-bd84-c562b151113d] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:55.428672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:55.429152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:55.430510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:55.430945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:55.444884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] HTTP exception thrown: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Request method failure captured: May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d HTTP/1.1 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-_FJNxKZlnZL9VXo2OLt7rsl8trtMQXGl1tW-Po72pRjtk951JuTHXogCXMgZKEN0qQpHMv0uLn1oP0tsPSEwG9s0A_zOA2SN7zW3TNB6hAdkSbSvCLl7168-I5ytVQYrymvO55nLNh9RqylUaTayJRgq9Or46wFLpT3QnOV7TYExg May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8c5f36ef25b441e4a4e019765530f370 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesActionsTest-1901869599 May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:24:55.447056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8c5f36ef25b441e4a4e019765530f370"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesActionsTest-1901869599 May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8c5f36ef25b441e4a4e019765530f370 May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesActionsTest-1901869599 May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesActionsTest-1901869599-project May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 596dd83622cd4fddbccbb70a98a970bc May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesActionsTest-1901869599-project May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. May 26 21:24:55.448384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '26cd4333-b73f-4e7b-bd84-c562b151113d'} May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:24:55.449151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. May 26 21:24:55.450401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:24:55.451472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] Returning 404 to user: Instance 26cd4333-b73f-4e7b-bd84-c562b151113d could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:24:55.451472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d84aff0-95e3-4585-80c6-56ed724472d9 tempest-VolumesActionsTest-1901869599 tempest-VolumesActionsTest-1901869599-project] 10.222.0.66 "GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d" status: 404 len: 111 microversion: 2.1 time: 0.032162 May 26 21:24:55.451472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 313/610] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:24:55 2022] GET /compute/v2.1/servers/26cd4333-b73f-4e7b-bd84-c562b151113d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:24:55.638132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-5dab24ec-0f85-4555-86a7-09eb5870be0a req-27fbdb59-d33f-4d88-bbb1-764291e5e5eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7353f7c0-bddc-4c45-84b7-534af0b2fed7", "tag": "b7bb9cad-415f-46ce-a0b3-0822cbd396cb"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:55.660479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-5dab24ec-0f85-4555-86a7-09eb5870be0a req-27fbdb59-d33f-4d88-bbb1-764291e5e5eb service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:55.660479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-5dab24ec-0f85-4555-86a7-09eb5870be0a req-27fbdb59-d33f-4d88-bbb1-764291e5e5eb service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:55.660479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-5dab24ec-0f85-4555-86a7-09eb5870be0a req-27fbdb59-d33f-4d88-bbb1-764291e5e5eb service nova] Creating event network-changed:b7bb9cad-415f-46ce-a0b3-0822cbd396cb for instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 on hv-cinder-82880 May 26 21:24:55.670795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-5dab24ec-0f85-4555-86a7-09eb5870be0a req-27fbdb59-d33f-4d88-bbb1-764291e5e5eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035996 May 26 21:24:55.671753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 298/611] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:24:56.793919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bedc262e-8d4b-497f-a4e0-4b997966c310", "device": "/dev/sdb"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:24:56.795585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:24:56.803616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:56.803616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:56.803616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:24:56.803948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:24:57.766409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6cd15ca0-9a07-43ce-a727-a3cf3535c6be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "POST /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.977172 May 26 21:24:57.771493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 314/612] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:24:56 2022] POST /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:40.399918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:40.400691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=15 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:40.406034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:40.406639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:40.413640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:40.414196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:40.415375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:40.415881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:40.550033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 850a6840-7053-4b1a-a335-d19c17bb9011 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:25:40.851139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5fb91cf1-866b-4a54-8057-4835e51556e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011/os-volume_attachments/bedc262e-8d4b-497f-a4e0-4b997966c310" status: 202 len: 0 microversion: 2.1 time: 0.452844 May 26 21:25:40.851885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 299/613] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:25:40 2022] DELETE /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011/os-volume_attachments/bedc262e-8d4b-497f-a4e0-4b997966c310 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:25:43.048560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=25 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:43.049475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:43.049889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:25:43.050732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:43.058588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:43.063897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:43.065165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.065574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.065677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.066031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.066548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.066859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.067017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.067338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.097948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2b7be7d3-d145-41e3-ac14-99fc8a3ea7e9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/ips" status: 200 len: 151 microversion: 2.20 time: 0.062814 May 26 21:25:43.098939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 300/614] 10.222.0.66 () {60 vars in 1288 bytes} [Thu May 26 21:25:43 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/ips => generated 151 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:25:43.103360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:25:43.349278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-969ac466-88c1-4a09-af37-10503ceb9992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 204 len: 0 microversion: 2.1 time: 0.316767 May 26 21:25:43.349869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 315/615] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:25:43 2022] DELETE /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:25:43.360285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:43.360988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:43.367194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.367702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.374080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:43.374080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:43.651565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:43.656425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-62994924-783d-460e-afff-5bc40ebfecc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1513 microversion: 2.1 time: 0.302208 May 26 21:25:43.657201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 301/616] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:25:43 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1513 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:25:44.674198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:44.675030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:44.683383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:44.684180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:44.685206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:44.685838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:44.839190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:44.846859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e63110c5-960a-4244-9da5-f92bc8ac5a34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1513 microversion: 2.1 time: 0.176927 May 26 21:25:44.849284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 316/617] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:25:44 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:25:45.865051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:45.869366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:45.881688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:45.882390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:45.883362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:45.883950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.137638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:46.146603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f99526da-62c7-4225-a35f-aeed18049a9b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1513 microversion: 2.1 time: 0.286048 May 26 21:25:46.152873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 302/618] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:25:45 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:25:46.374009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:46.375261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:46.389461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:46.389918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.390781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:46.391112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.426120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d642aac4-ab6e-4ddf-a9d2-4613311b30a2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.057070 May 26 21:25:46.431329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 317/619] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:25:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:46.452691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:25:46.453763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:46.465578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:46.467326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.470390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:46.471135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.528315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-26dc812b-1acf-4c09-8eb8-c778eb6f0212 req-cf782424-8b42-4208-9ddd-e48a9b9b9f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "850a6840-7053-4b1a-a335-d19c17bb9011", "name": "network-vif-deleted", "tag": "f1247d33-077f-47f9-af05-4f54e79aedb6"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:25:46.532014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lazy-loading 'flavor' on Instance uuid 40e09a92-16a3-42f4-8961-6cb2a1decba3 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:25:46.540815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-26dc812b-1acf-4c09-8eb8-c778eb6f0212 req-cf782424-8b42-4208-9ddd-e48a9b9b9f14 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:46.544934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-26dc812b-1acf-4c09-8eb8-c778eb6f0212 req-cf782424-8b42-4208-9ddd-e48a9b9b9f14 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:46.582171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-26dc812b-1acf-4c09-8eb8-c778eb6f0212 req-cf782424-8b42-4208-9ddd-e48a9b9b9f14 service nova] Creating event network-vif-deleted:f1247d33-077f-47f9-af05-4f54e79aedb6 for instance 850a6840-7053-4b1a-a335-d19c17bb9011 on hv-cinder-82880 May 26 21:25:46.589155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-26dc812b-1acf-4c09-8eb8-c778eb6f0212 req-cf782424-8b42-4208-9ddd-e48a9b9b9f14 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065789 May 26 21:25:46.589757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 318/620] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:47.117211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:47.117919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:47.124512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.125195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.126076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.127470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.128837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cb987f96-6bff-4e31-86f9-74d539fdadb1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/action" status: 202 len: 0 microversion: 2.20 time: 0.683831 May 26 21:25:47.129615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 303/621] 10.222.0.66 () {62 vars in 1318 bytes} [Thu May 26 21:25:46 2022] POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:25:47.138561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:47.139261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:47.146104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.146779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.147751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.148383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.158390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-64f40d72-8502-464c-81e8-ab23e8df151f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/ips" status: 200 len: 149 microversion: 2.1 time: 0.048428 May 26 21:25:47.158955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 319/622] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:25:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:25:47.164148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:47.165011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:47.178952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.179463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.183986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.183986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.227412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:47.228288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:47.228922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'fault' on Instance uuid 850a6840-7053-4b1a-a335-d19c17bb9011 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:25:47.294971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:47.306207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-84ddb1a5-c840-454e-a3b3-e66afc3cbeb3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 200 len: 1309 microversion: 2.1 time: 0.145359 May 26 21:25:47.308056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 320/623] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:25:47 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 1309 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:25:47.371168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:47.384899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:47.384899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:47.384899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e06ad323-2f54-458f-bb43-19b40feccab7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.250165 May 26 21:25:47.393602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 304/624] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:47 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:25:48.326375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:48.327158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 850a6840-7053-4b1a-a335-d19c17bb9011] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:48.335170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:48.339189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:48.339189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:48.339189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:48.355963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] HTTP exception thrown: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Request method failure captured: May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 HTTP/1.1 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-_nTdn-VGltbDKCq8M4T3-1TIHO--GS8lpRY56ENIIHKrVmJnz1B-oIUrjDaBDniAjKBFcLSj59LgKxu32Q93FyW4rRU1nC7usMyy_vbSVNFiZpCbjFCM_GIFtdTYmZgohjYLFWIpGGVce5Uy3iCn2VNv2X9P6eebz5sxniGlv-DSg May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:25:48.358843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: f45b8987f3c24cf19de0fa81482c050a May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. May 26 21:25:48.360737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '850a6840-7053-4b1a-a335-d19c17bb9011'} May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:25:48.361656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. May 26 21:25:48.363268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:25:48.364929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Returning 404 to user: Instance 850a6840-7053-4b1a-a335-d19c17bb9011 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:25:48.364929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e25ac5b-f19c-4ca8-8673-0d7708822a9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011" status: 404 len: 111 microversion: 2.1 time: 0.039686 May 26 21:25:48.367012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 321/625] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:25:48 2022] GET /compute/v2.1/servers/850a6840-7053-4b1a-a335-d19c17bb9011 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:25:48.404188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:48.405441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:48.418479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:48.420227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:48.423718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:48.424200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:48.601782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:48.612468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:48.614039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:48.615225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dec2db3d-d569-4b80-a43c-a10bc7b5b4c2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.215484 May 26 21:25:48.615794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 305/626] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:48 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:49.634024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:49.634693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:49.642032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:49.642465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:49.643430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:49.648634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:49.783624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:49.802462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:49.806115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:49.808574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d2917ca7-56c1-4b0b-a7cc-bd17e30cbbd6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.178917 May 26 21:25:49.809880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 322/627] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:49 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:50.264240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d5d8e5a-7439-4cae-b177-439d61cc1b47"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:25:50.265815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:50.282346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:50.282910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:50.283815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:50.284382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:50.828329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:50.828987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:50.835843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:50.836375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:50.837296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:50.837729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:51.018411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:51.027769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:51.029448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:51.030967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0cf73175-8158-4623-a605-52ce4653330d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.206781 May 26 21:25:51.032031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 323/628] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:50 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:25:52.050787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:52.052107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:52.074739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:52.075439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:52.076408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:52.077033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:52.224554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:52.233679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:52.235633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:52.236412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-77062575-707e-46e2-8121-220848f03a8d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.189855 May 26 21:25:52.237007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 324/629] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:52 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:25:53.256560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:53.257156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:53.266731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:53.267198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:53.267982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:53.268429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:53.461370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:53.471943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:53.473785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:53.475993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a66b9fad-acbc-4fb7-96bf-ece2db11a465 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.223871 May 26 21:25:53.477135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 325/630] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:53 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:54.499094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:54.500467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:54.522920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:54.523413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:54.524211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:54.526617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:54.725695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:54.734544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:54.736333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:54.737957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e39ed0c-f1ec-46a6-b098-4afdcffb8211 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.246333 May 26 21:25:54.738762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 326/631] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:54 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:25:55.760934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:55.762599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:55.786210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:55.786210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:55.786210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:55.786210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:55.938234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:55.958255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:55.961950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:55.963814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f7a8943-b8b4-433e-a446-b48ef63dc1df tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.208947 May 26 21:25:55.964741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 327/632] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:55 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:56.985704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:56.987118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:56.998857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:56.999550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:57.000535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:57.001501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:57.197481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:57.206491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:57.208315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:57.209748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2212bce8-d6d5-42f7-b21c-35363f7df63a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.231070 May 26 21:25:57.221857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 328/633] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:56 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:58.236021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:58.243299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:58.253635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:58.254418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:58.255401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:58.255999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:58.428676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:58.442884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:58.444384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:25:58.446153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8a86edb2-21df-471c-9c91-88f88e5e7bcf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.220136 May 26 21:25:58.447035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 329/634] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:58 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:25:58.503508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15255945-1c40-4366-8435-bee94680a534 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.243419 May 26 21:25:58.511151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 306/635] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:25:50 2022] POST /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 194 bytes in 8252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:25:59.469809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:25:59.477985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:59.491582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:59.492259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:59.493882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:59.494646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:59.971253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0105d0ec-9ef3-4075-9c45-15852cc7c852"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:25:59.972639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:25:59.981372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:59.982079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:25:59.983048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:25:59.983657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:00.016724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:00.072301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:00.075880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:00.080545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0f3d2fc-e0ad-405d-a303-9ed8c76fc078 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.615338 May 26 21:26:00.088714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 330/636] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:25:59 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:01.097379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:01.098016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:01.104924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:01.107777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:01.107777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:01.107777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:01.124524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:01.253406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:01.262896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:01.264438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:01.265741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-164febd9-bce9-4c25-8449-79744791a893 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.172230 May 26 21:26:01.266259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 331/637] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:01 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:01.268713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a46ba29-bc68-4269-b343-6287a03dc6c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.301259 May 26 21:26:01.274120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 307/638] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:25:59 2022] POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 194 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:02.287637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:02.288489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:02.298475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:02.298941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:02.299773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:02.300226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:02.514685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:02.526597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:02.528691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:02.530066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-201c12cd-1066-4b7e-b250-bb19f0679324 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.246747 May 26 21:26:02.530997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 332/639] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:02 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:03.549771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:03.551007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:03.559013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:03.559467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:03.560275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:03.560687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:03.736983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:03.747117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:03.748694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:03.749856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17de174b-9db5-4e0f-b474-a0ebea3db4fe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.204806 May 26 21:26:03.764430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 308/640] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:03 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:04.771376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:04.772822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:04.781154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:04.781982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:04.782903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:04.783419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:04.925065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:04.933379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:04.934893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:04.936119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-33618f1f-6887-4159-ba34-130b113c9dfb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.168791 May 26 21:26:04.936771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 333/641] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:04 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:05.264015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1b0f4d8-3335-40fd-9822-b4c71243821a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'create', calling method: .version_select at 0x7f46c81a7e50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1406618544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUUgad3WttULDy3WDryYf4Gtt0GIT0wMLq93vFaep3PTOw+bOmOCp4NVXeSPBhhtlQ4sg8XPJqkBQclBGjZeSjoYRFRYClEf8BB93PDt4RFfog7hBnbn/LXPy0OEcqGNg=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:05.278273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-d1b0f4d8-3335-40fd-9822-b4c71243821a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Getting quotas for project 198b0d7e8b204f858abb8474f90af623. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:05.284424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-d1b0f4d8-3335-40fd-9822-b4c71243821a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Getting quotas for user d3e7bb3f129f47c7869f3319f35ed15e and project 198b0d7e8b204f858abb8474f90af623. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:05.392054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1b0f4d8-3335-40fd-9822-b4c71243821a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.133090 May 26 21:26:05.392747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 309/642] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:26:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:05.500505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2140529819", "imageRef": "8bd10df0-99a2-4070-8249-4640bc56c683", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1406618544", "networks": [{"uuid": "58363eed-6878-46fa-90fb-ed0ed8302ecf"}]}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:05.553282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] validate_networks() for [('58363eed-6878-46fa-90fb-ed0ed8302ecf', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:26:05.956772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:05.957412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:05.964858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:05.965413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:05.966280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:05.966792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:06.005373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:26:06.006103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:26:06.006628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:26:06.007056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:26:06.007466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:26:06.017767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:06.018208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:06.019003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:06.019434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:06.037736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Getting quotas for project 198b0d7e8b204f858abb8474f90af623. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:06.042294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Getting quotas for user d3e7bb3f129f47c7869f3319f35ed15e and project 198b0d7e8b204f858abb8474f90af623. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:06.054033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:26:06.056270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8bd10df0-99a2-4070-8249-4640bc56c683',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:26:06.112321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:06.121454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:06.122989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:06.124251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-80792c1d-e7cd-4ed0-b945-ec39dd781cff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.173144 May 26 21:26:06.124888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 310/643] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:05 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:06.208631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a9ff8597-77af-4efe-8509-2c5e8a6a9b5e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711739 May 26 21:26:06.209520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 334/644] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:26:06.220471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-50e4ab6c-053d-4ccf-9dc0-2340b919510f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:06.221415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-50e4ab6c-053d-4ccf-9dc0-2340b919510f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:06.287949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-50e4ab6c-053d-4ccf-9dc0-2340b919510f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:06.296701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-50e4ab6c-053d-4ccf-9dc0-2340b919510f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1259 microversion: 2.1 time: 0.080806 May 26 21:26:06.297997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 311/645] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1259 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:07.144086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:07.144766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:07.152160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:07.152642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:07.153451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:07.153893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:07.299319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:07.314061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:07.317605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:07.319793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d314fb17-eb3a-474e-b91b-d53e759815eb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.180031 May 26 21:26:07.322107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ce08cc9f-8e3c-45a7-952f-203b861cdbe7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:07.323399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ce08cc9f-8e3c-45a7-952f-203b861cdbe7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:07.334171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 335/646] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:07 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:07.392737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ce08cc9f-8e3c-45a7-952f-203b861cdbe7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:07.402415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ce08cc9f-8e3c-45a7-952f-203b861cdbe7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1259 microversion: 2.1 time: 0.084646 May 26 21:26:07.403184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 312/647] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1259 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:08.341283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:08.341888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:08.348368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.348844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.349603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.350034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.421234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:08.421884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:08.430898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.432146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.432522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:08.433065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:08.458031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:08.519746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:08.528657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:08.529561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f82e084-77a2-4ebd-9f38-284bce97e4ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1263 microversion: 2.1 time: 0.112902 May 26 21:26:08.530639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 313/648] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:08 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1263 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:08.536576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:08.538449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:08.539203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4bf98662-4449-4c18-82e3-e14860930b04 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.202403 May 26 21:26:08.539751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 336/649] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:08 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:09.547480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:09.548308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:09.557445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:09.557988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:09.560919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:09.561460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:09.563934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:09.564833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:09.571329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:09.571781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:09.572566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:09.573098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:09.648302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:09.657712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7472572d-a6d0-4af3-a5b7-bf41e56e3aa2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1263 microversion: 2.1 time: 0.114217 May 26 21:26:09.658605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 314/650] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:09 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1263 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:09.720425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:09.729020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:09.730608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:09.731788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2c10497-18b5-4225-8431-af1054487f85 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.172335 May 26 21:26:09.732338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 337/651] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:09 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:09.830955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-930339482", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "networks": [{"uuid": "223f2c8f-b144-4e90-a07c-5cbfe60adb05"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:09.881566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] validate_networks() for [('223f2c8f-b144-4e90-a07c-5cbfe60adb05', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:26:10.246407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:26:10.246835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:26:10.247343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:26:10.247755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:26:10.248169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:26:10.258193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.261617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:10.261617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.261617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:10.276931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Getting quotas for project 31ea80663206487ca3ea28c5bb4239f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:10.281244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Getting quotas for user f45b8987f3c24cf19de0fa81482c050a and project 31ea80663206487ca3ea28c5bb4239f0. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:10.292896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:26:10.297507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:26:10.408651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5f0d9c63-e639-4187-a444-7f58c1f3fb2d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581681 May 26 21:26:10.411955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 315/652] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:26:10.420154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5dbf2bc-0c4e-4f1d-bc3f-ab42825295b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:10.420796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5dbf2bc-0c4e-4f1d-bc3f-ab42825295b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:10.490610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5dbf2bc-0c4e-4f1d-bc3f-ab42825295b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:10.498015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5dbf2bc-0c4e-4f1d-bc3f-ab42825295b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1218 microversion: 2.1 time: 0.082295 May 26 21:26:10.498587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 338/653] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:10 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:10.678566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:10.679275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:10.687066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.687514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:10.688442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.688803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:10.750464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:10.751097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:10.759440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.760205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:10.761620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:10.762287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:11.007377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:11.015763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-74a47977-33b7-468e-b646-51e29ad6ac12 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1255 microversion: 2.1 time: 0.342978 May 26 21:26:11.016351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 316/654] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1255 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:11.108545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:11.116920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:11.118432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:11.119701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fb837b7e-6cdb-4581-bac7-4842c6bfaaaf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.373409 May 26 21:26:11.120268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 339/655] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:10 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:11.515841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:11.516456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:11.518449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:11.523253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:11.523698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:11.524568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:11.525102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:11.590848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:11.599147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6e602f5a-71fe-4368-853a-0e6633f77212 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1222 microversion: 2.1 time: 0.087207 May 26 21:26:11.599731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 317/656] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:11.785851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-803ee3d2-37e4-4def-9c92-722dab63d084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: .version_select at 0x7f46cd45ce50>, body: {"keypair": {"name": "tempest-keypair-1340486138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG2uqT1sXbg2ra/GRlMPdFeBwjjufIlVplzXYVBdPqDpPc0/05Y+wLvTY6U/KTeB5d9UOOrX7f9/BK7eqjMENjUVk/9aum/17OKTqpAw0L/HBhUhj1dU+zHtvmNs8nV7+Q=="}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:11.807795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-803ee3d2-37e4-4def-9c92-722dab63d084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:11.812542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-803ee3d2-37e4-4def-9c92-722dab63d084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:11.940052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-803ee3d2-37e4-4def-9c92-722dab63d084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.158841 May 26 21:26:11.940802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 340/657] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:26:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:12.035754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:12.036513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:12.044431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.044879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.045735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.046239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.143042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:12.143714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:12.152482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:12.154968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.155797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.156673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.157393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.161874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d537d9a1-682f-406b-a935-80ff6bcb169c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1319 microversion: 2.1 time: 0.130077 May 26 21:26:12.174086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 318/658] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1319 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:12.322810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:12.331595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:12.333149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:12.334329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-361fe165-36e2-4c39-93ac-30e07dc98991 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.198814 May 26 21:26:12.334886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 341/659] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:12 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:12.620720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:12.624283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:12.631271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.631721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.632502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:12.632998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:12.736400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:12.745876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-918dc240-3756-496f-b7bb-07fd791ab203 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1278 microversion: 2.1 time: 0.132366 May 26 21:26:12.757692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 319/660] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1278 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:13.182782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:13.185042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:13.193102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.194101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.195036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.195532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.344776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:13.357253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-37e33066-3cb6-41fd-b0cc-17114c714849 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1317 microversion: 2.1 time: 0.180519 May 26 21:26:13.357839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:13.358467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:13.358983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 342/661] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:13.374629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.375376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.376326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.377120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.763794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:13.769045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:13.790184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:13.797089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.805971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.806689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:13.807137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:13.846739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:13.856042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:13.870654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:13.872034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-18288453-6e2b-465e-922d-b9f1b3f34e96 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.522238 May 26 21:26:13.884121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 320/662] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:13 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:13.914380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:13.931958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b50a8b57-6564-4ef7-a4f2-1917d145e1bf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1276 microversion: 2.1 time: 0.171886 May 26 21:26:13.935281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 343/663] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:14.376269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:14.377095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:14.384897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:14.385497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:14.386962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:14.387577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:14.529293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:14.538319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3ddb24cf-1622-40b1-9bac-5ce9e2309643 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.166119 May 26 21:26:14.538918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 321/664] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:14.764193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1070073671", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e07a43e-b6dc-4850-bc07-d904a80346a4"}], "security_groups": [{"name": "tempest-securitygroup--730571451"}], "key_name": "tempest-keypair-1340486138", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:14.879596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] validate_networks() for [('4e07a43e-b6dc-4850-bc07-d904a80346a4', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:26:14.893775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:14.894673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:14.912988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:14.912988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:14.913709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:14.914997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.102100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.115090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.116854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.118323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-56889e5c-6908-48d4-aff4-309b2236206e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.228908 May 26 21:26:15.119380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 322/665] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:14 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:15.125268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:15.126014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:15.132516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.133074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.133880 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.134316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.372742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.381449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed4e7727-72eb-4fc5-a2c0-e94efd2ceaa5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.259736 May 26 21:26:15.382884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 323/666] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:15.454347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:26:15.454780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:26:15.455262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:26:15.455676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:26:15.456121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:26:15.465762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.466215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.467024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.467461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.484071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:26:15.488038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:26:15.499321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:26:15.501503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:26:15.555332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:15.555887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:15.563197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.563647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.564416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:15.564880 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:15.666607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4edccbb6-5466-440d-88d1-6495ecabcb55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.907238 May 26 21:26:15.669172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 344/667] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:26:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:26:15.684049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-123792e0-254b-444d-92f5-826969ca46c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:15.684911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-123792e0-254b-444d-92f5-826969ca46c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:15.716487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.724430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-58967ec3-1811-4935-b79e-0021d9221883 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.172960 May 26 21:26:15.726183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 324/668] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:15 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:15.764543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-123792e0-254b-444d-92f5-826969ca46c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:15.775709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-123792e0-254b-444d-92f5-826969ca46c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1242 microversion: 2.1 time: 0.101367 May 26 21:26:15.777901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 345/669] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:15 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:16.142801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:16.143293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:16.160108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.169367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.170625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.171513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.379864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.389840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.390737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.391870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4aa24f82-786b-4e8a-bedb-b4c4299e6baf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.257396 May 26 21:26:16.392438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 325/670] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:16 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:16.408910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:16.409749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:16.418201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.418651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.419417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.419849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.590296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.598223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-af34b131-533d-4632-8189-0baea2910f26 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.193847 May 26 21:26:16.598801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 346/671] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:16.742469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:16.743091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:16.749922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.750542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.751385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.751833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.794879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:16.795587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:16.806754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.808532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.813239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:16.813239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:16.899778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.922165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-55dad85f-af2f-4bac-a19d-0e10f89a35bc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.129676 May 26 21:26:16.922165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 347/672] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:16 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:16.932316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:16.945304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-22b8d4a6-19c0-48fa-940f-7659dea29ec4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.206928 May 26 21:26:16.946629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 326/673] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:16 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:17.411778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:17.412481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:17.419021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.420321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.421496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.422255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.564415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:17.573044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:17.575256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:17.576511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5bea6b56-47c5-4e21-8cb7-45e29b752476 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.168731 May 26 21:26:17.577354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 348/674] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:17 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:17.617787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:17.618407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:17.625621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.626359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.627137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.627575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.762865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:17.771274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-731e8ae7-57c7-4fb5-a2c7-137dc2b2cf9e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.157332 May 26 21:26:17.771844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 327/675] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:17 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:17.937729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:17.938613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:17.945373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.945904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.946732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.947171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.971595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:17.974887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:17.978883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.979404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:17.981393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:17.989242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:18.027573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.038076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ac4951b0-3ebd-4540-803b-94a9b2c6733f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.103404 May 26 21:26:18.039318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 349/676] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:17 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:18.141302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.150425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1ebd501-67bf-45b1-b41c-d49319c60f63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.182947 May 26 21:26:18.153285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 328/677] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:18.595659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:18.596361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:18.604373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:18.604857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:18.605631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:18.606067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:18.788467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:18.789193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:18.796288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:18.797002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:18.797780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:18.798212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:18.842894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.851267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.852804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.853968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-38515412-3456-4801-8b77-c7be3710b93f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.262375 May 26 21:26:18.854574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 350/678] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:18 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:18.947131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:18.956071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-44b71463-f161-45db-92ef-cf0b5b68f543 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.171381 May 26 21:26:18.956704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 329/679] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:19.058160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:19.058939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:19.069803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.070256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.071038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.071475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.154213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:19.162103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e7009eb4-4498-4180-884a-863a7e89e35d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.108467 May 26 21:26:19.162682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 351/680] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:19 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:19.169453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:19.170072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:19.176033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.176485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.177292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.177732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.317510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:19.321099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:19.325644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cbc1fc7b-5758-460e-9637-134b87a09752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.160472 May 26 21:26:19.326218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 330/681] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:19.874593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:19.875680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:19.883215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.883996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.885079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.886288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.906473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:19.981318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:19.982711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:19.991684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.992489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:19.993524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:19.994483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:20.084128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.093872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.095665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.096889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1214394-4ea7-47a1-b401-30bf8fff7ff7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.226634 May 26 21:26:20.097775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 352/682] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:19 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:20.161352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.168959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2d82aff9-7b17-42e6-a308-5078db1b945b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.198957 May 26 21:26:20.169558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 331/683] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:20.179312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:20.180173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:20.186865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:20.187308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:20.188076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:20.188506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:20.252095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.260065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-016faf89-7e07-46bd-9d60-9d865859f5cc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.084587 May 26 21:26:20.261549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 353/684] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:20 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:20.342847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:20.343773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:20.345993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:20.346678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=14 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:20.352273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:20.352776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:20.357232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:20.357232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:20.502254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:20.509928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-479e9127-89b2-4747-baa8-4e299e413b1a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.170950 May 26 21:26:20.510516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 332/685] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:20 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:21.117841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:21.118833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:21.127439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.128352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.129478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.130032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.193848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:21.193848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:21.193848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.194537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.194884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.195395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.345454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.354217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.356341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.357544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-37f93a7f-d54d-4e22-b923-921b294dac56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.245876 May 26 21:26:21.358110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 354/686] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:21 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:21.362612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:21.363222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:21.369368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.369816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.370617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.371049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.385528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.394320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4400e8a4-eddf-44d1-a0bc-6babc2211367 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.212483 May 26 21:26:21.395577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 333/687] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:21.451024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.458528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5fbc6001-ffb7-4fb7-a021-b8e4a04c5a9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.099459 May 26 21:26:21.459136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 355/688] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:21 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:21.528233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:21.528892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:21.547768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.547768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.547768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:21.547768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:21.707122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:21.743444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b8cd9673-e94b-4cef-ac82-7ef81ddda3c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.194181 May 26 21:26:21.743444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 334/689] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:22.376121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:22.377033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:22.383738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.384196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.385296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.385842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.411640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:22.412353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:22.419619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.420151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.420960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.421400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.579528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.588353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.590462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.591650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8045274c-65b0-4a68-8790-d3409f008d79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.219518 May 26 21:26:22.592216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 356/690] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:22 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:22.608719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.616635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2d513e1f-53c2-4b70-98c2-046f6d24814e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.208720 May 26 21:26:22.617564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 335/691] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:22.665973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:22.666607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:22.674006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.674467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.675579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.676024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.739954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.751352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-37586d74-8717-4011-b013-30521d7d9521 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.158036 May 26 21:26:22.751938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 357/692] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:22 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:22.759292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:22.760290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:22.767252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.767977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.769098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:22.769840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:22.939062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:22.946970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fbb6de9a-de1a-4511-bfeb-3fb6bf98ecc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.191510 May 26 21:26:22.947549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 336/693] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:22 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:23.610945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:23.611699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:23.619479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.619919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.621395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.621861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.634188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:23.634830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:23.641581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.644752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.644752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.644752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.825843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:23.834171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:23.835827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:23.837249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0d15810-c058-4043-932f-4ff9ba05a544 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.230335 May 26 21:26:23.837856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 358/694] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:23.845653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:23.846593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:23.862028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:23.870970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fa760afa-4bd1-4e2a-88ca-61e9ea2f5cdb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.240147 May 26 21:26:23.875905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 337/695] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:23 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:23.876129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.876129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.876129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.876129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.945034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:23.952876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8929ad03-6ab2-47e7-9e6c-f91f44d4670c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.110864 May 26 21:26:23.953464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 359/696] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:23 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:23.967401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:23.968022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:23.974856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.975303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:23.976085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:23.976533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:24.111810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:24.120801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a31f7796-d648-4190-9ad0-a5d66e99d6a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.157834 May 26 21:26:24.120801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 338/697] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:24.861088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:24.864782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:24.868270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:24.868763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:24.869535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:24.870684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:24.889295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:24.891135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:24.899409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:24.899949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:24.900968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:24.902067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:25.176876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.185665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.188211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.188612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.190024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-285b1a19-b011-4e52-962c-c6b820e54417 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.333224 May 26 21:26:25.202528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 360/698] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:25.203520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1b6ee8fe-95cf-4bf7-8bb6-6ab674c02378 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.319855 May 26 21:26:25.204246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 339/699] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:25.207634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:25.208457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:25.216085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:25.216474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:25.217295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:25.217743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:25.218439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:25.219069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:25.230401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:25.233883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:25.234728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:25.235166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:25.310307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.318384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5095dbcf-cc9b-4b9b-a8ca-24b3d5a06822 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.114488 May 26 21:26:25.328155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 361/700] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:25 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:25.408147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:25.417926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-271b42ef-10fa-445d-8789-a0d391348e76 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.209418 May 26 21:26:25.418834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 340/701] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:25 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:26.209404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:26.210291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:26.215803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:26.216991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=20 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:26.219860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.221159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.222506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.223009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:26.223796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:26.224065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.234769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.235718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.236914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.237804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.679486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.689614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.691136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.692310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3a86a7ec-d06c-4449-9a39-af19e460ec9a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.486876 May 26 21:26:26.692969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 362/702] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:26 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:26.709557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.709725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:26.710305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:26.718273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3c142225-62d8-4da2-a512-0ed6add4181b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.500905 May 26 21:26:26.721267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 341/703] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:26 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:26.721392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.721392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.721392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.721392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.723480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:26.724388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:26.730874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.731390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.732222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:26.732814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:26.826335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.835659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2725839-ce1c-47a4-af00-8627b10c58c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.141599 May 26 21:26:26.837137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 363/704] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:26 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:26.892862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:26.900621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bbc24a23-1015-46b9-a823-5aadb68e1bc7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.180722 May 26 21:26:26.901748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 342/705] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:27.711024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:27.711573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:27.718294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.718752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.719524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.719973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.736908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:27.737533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:27.743825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.744274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.745598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.746037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.924507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:27.927766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:27.933188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:27.934729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:27.935777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e7ad4de8-c89f-46e0-b506-52ff49f38800 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.202688 May 26 21:26:27.935910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-39b02584-8234-48d6-a5b6-2e9d67b7c1da tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.229068 May 26 21:26:27.936342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 343/706] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:27.936574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 364/707] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:27 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:27.941273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:27.942100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:27.949235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.949701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.950797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:27.950976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.950976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.951160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:27.957703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.958032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:27.958795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:27.959227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:28.037345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:28.044945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a3276752-0794-44fa-966f-b5845a03c48b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.098680 May 26 21:26:28.045550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 344/708] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:27 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:28.103542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:28.111583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-67070f4c-8ed6-4c81-9bda-2243f93c9fb8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.173795 May 26 21:26:28.112268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 365/709] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:28.952398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:28.953051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:28.956831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:28.957456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:28.959772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:28.960223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:28.961028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:28.961470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:28.963876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:28.964335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:28.965141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:28.965581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:29.156931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.159522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.164456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fc9b4214-0f72-4906-b448-7fb0a1eb3341 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.215859 May 26 21:26:29.165109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 345/710] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:28 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:29.168083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.169627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.170062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:29.170674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:29.170775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e677ddfc-243d-4bc9-bee4-e9db8b47b425 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.217908 May 26 21:26:29.171331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 366/711] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:28 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:29.176132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:29.176851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:29.176999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:29.177303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:29.178073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:29.178506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:29.183561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:29.184103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:29.185080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:29.185527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:29.268700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.276870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d630b2d6-6c04-4678-8d57-8c82bfe5614d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1246 microversion: 2.1 time: 0.110195 May 26 21:26:29.277506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 346/712] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:29 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:29.336483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:29.344478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-38b1a1d7-9fb9-4897-b805-10bced9b312d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.172045 May 26 21:26:29.345254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 367/713] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:30.182234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:30.183353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:30.189654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:30.190360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:30.190572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.191023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.191846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.192282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.196999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.197567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.199431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.200441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.211825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:30.577866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:30.587220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:30.588784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:30.590167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-668838fe-a65c-4678-9013-5ff863e09910 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.404425 May 26 21:26:30.595977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:30.601249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 368/714] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:30 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:30.606850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:30.614958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:30.615090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c34699a-682c-4b12-922c-a7e9b046109e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.429183 May 26 21:26:30.615090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 347/715] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:30.615255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.615255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.615415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.615810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.624242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:30.625055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:30.626745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:30.640670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.640670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.640670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:30.640670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:30.778350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:30.786188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da7483de-692f-4cd6-803d-32becd144d45 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1238 microversion: 2.1 time: 0.183610 May 26 21:26:30.786763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 369/716] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:30 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:31.053980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:31.063239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1d416a16-5ea5-415c-a5cf-0d09c342a7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.449985 May 26 21:26:31.064065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 348/717] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:31.609741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:31.610449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:31.630612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.631022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:31.631197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:31.632092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:31.634972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.636194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:31.642436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.643100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:31.644237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.644948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:31.964077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:31.967051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:31.974200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d85ea781-6d99-4954-a715-21b82e8303b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.347415 May 26 21:26:31.974821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 349/718] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:31 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:31.975972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:31.977855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:31.979026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a9df941e-20b0-473a-81bb-14cf74df6747 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1724 microversion: 2.20 time: 0.373236 May 26 21:26:31.980221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 370/719] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:31 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:31.980539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:31.981175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:31.987303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.987749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:31.988554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:31.988994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:32.077795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-677eceee-1315-4cbe-bd3b-c204b5917079 req-6e43d562-d93a-4a18-b754-ed1548e90818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:32.087949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:32.091207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-677eceee-1315-4cbe-bd3b-c204b5917079 req-6e43d562-d93a-4a18-b754-ed1548e90818 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:32.091876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-677eceee-1315-4cbe-bd3b-c204b5917079 req-6e43d562-d93a-4a18-b754-ed1548e90818 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:32.107701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e1df2ddf-b681-4d25-8f7b-6210129755d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1294 microversion: 2.1 time: 0.123504 May 26 21:26:32.107701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 350/720] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:31 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:32.107701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:32.108328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:32.116791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-677eceee-1315-4cbe-bd3b-c204b5917079 req-6e43d562-d93a-4a18-b754-ed1548e90818 service nova] Creating event network-changed:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:26:32.126449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-677eceee-1315-4cbe-bd3b-c204b5917079 req-6e43d562-d93a-4a18-b754-ed1548e90818 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052591 May 26 21:26:32.126645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:32.126963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:32.127751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:32.128188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:32.128602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 371/721] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:26:32.282223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:32.289709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-52b774d1-a0be-4a69-a6b4-f787cc42b598 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.188318 May 26 21:26:32.290272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 351/722] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:32.992094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:32.992824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:32.999494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:32.999953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.000768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.001211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.006107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:33.006743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:33.013560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.014027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.014799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.015242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.580485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:33.588445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3a7a64ad-6618-4cb8-8dea-4a3b93bfa462 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.600964 May 26 21:26:33.589361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:33.598730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 372/723] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:33.598933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:33.600536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:33.601774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-033ace87-e6b6-4baa-9bc4-d7927a66bd6f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.599572 May 26 21:26:33.605616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 352/724] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:33 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:33.605767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:33.605767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:33.608806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:33.609598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:33.611709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.612415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.613526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.614282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.616432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.616917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.617805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.618258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.786721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:33.795389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5c0025d9-dcca-4e1b-bba3-23d3fcb628fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1302 microversion: 2.1 time: 0.195296 May 26 21:26:33.796321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 373/725] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:33 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1302 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:33.801647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f77f2fd1-56ff-441e-8922-b759ccc254cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:33.809587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77f2fd1-56ff-441e-8922-b759ccc254cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:33.810066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77f2fd1-56ff-441e-8922-b759ccc254cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:33.874395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f77f2fd1-56ff-441e-8922-b759ccc254cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Going to try to stop instance {{(pid=118354) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 26 21:26:34.078023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.085907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71eab4d6-2511-44b2-8d2e-f87ad69c26eb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.481335 May 26 21:26:34.086487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 353/726] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:33 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:34.107790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f77f2fd1-56ff-441e-8922-b759ccc254cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action" status: 202 len: 0 microversion: 2.1 time: 0.309979 May 26 21:26:34.108392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 374/727] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:26:33 2022] POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:26:34.118064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:34.118588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:34.125502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.130076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.130076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.130076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.278094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-62b7f750-36d2-4339-957b-5ecc41ff5a88 req-03064f16-1c74-4ebd-8dd7-4065344f81f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6ec354-4f9e-406a-80a5-90856a7fead8", "tag": "241fdbd4-c846-46aa-a9a2-27a629464f87"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:34.287658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-62b7f750-36d2-4339-957b-5ecc41ff5a88 req-03064f16-1c74-4ebd-8dd7-4065344f81f0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.289716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-62b7f750-36d2-4339-957b-5ecc41ff5a88 req-03064f16-1c74-4ebd-8dd7-4065344f81f0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.299764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-62b7f750-36d2-4339-957b-5ecc41ff5a88 req-03064f16-1c74-4ebd-8dd7-4065344f81f0 service nova] Creating event network-changed:241fdbd4-c846-46aa-a9a2-27a629464f87 for instance 0e6ec354-4f9e-406a-80a5-90856a7fead8 on hv-cinder-82880 May 26 21:26:34.305030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-62b7f750-36d2-4339-957b-5ecc41ff5a88 req-03064f16-1c74-4ebd-8dd7-4065344f81f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158492 May 26 21:26:34.305623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 375/728] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:26:34.432962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.444550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fca64a9d-39a1-4a81-b5f1-7d7d373d2ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.330520 May 26 21:26:34.445211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 354/729] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:34.607098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:34.607808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:34.614101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.614551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.615354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.615803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.625220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:34.625835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:34.632057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.632543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.633557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.633999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.888313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.896835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.898337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.899497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ad24a74f-4473-4cce-babe-6a2017c3527b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.278174 May 26 21:26:34.900053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 355/730] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:34 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:34.907270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:34.914919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:34.915187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b5a1a87-1834-43a2-af74-d42b7bcf34e0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.312823 May 26 21:26:34.915605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:34.915958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 376/731] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:34.929712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.930155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.930929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:34.931356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:34.997429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:35.008444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-16c5af5f-8b08-4fc4-ab13-8414d93cdd73 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1300 microversion: 2.1 time: 0.106807 May 26 21:26:35.010125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 356/732] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:34 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:35.103123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:35.103647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:35.110258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.110823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.112168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.112726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.342989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:35.350878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a404b869-0156-44a4-99fd-9a89f332f0d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.251785 May 26 21:26:35.351456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 377/733] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:35 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:35.461937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:35.462723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:35.469253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.469703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.470466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.470903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.601098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:35.609507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4a2ad174-4ad3-49c2-a2bc-79c212a08083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.151452 May 26 21:26:35.610078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 357/734] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:35.919055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:35.919700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:35.925735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.926182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.933036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.933036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.933377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:35.933476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:35.940147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.940617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:35.941503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:35.941831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.147059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.154698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.157455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.159457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.160743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5a99f919-3de9-47a7-a91e-7493ecfc3ad5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.246111 May 26 21:26:36.163660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7a40e350-a46b-4186-a952-36003aa0708a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.235161 May 26 21:26:36.164263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 358/735] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:35 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:36.170292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 378/736] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:35 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:36.172679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:36.173547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:36.191484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.191934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.192793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.193226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.338388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.346858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4ee125fd-07a8-40b3-9e1d-a620c6724cf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.181149 May 26 21:26:36.347454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 359/737] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:36 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:36.367415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:36.367989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:36.374307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.374762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.375542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.375988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.516965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.524250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-edd6dd08-0b90-40f6-94aa-82c241ce52d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.160766 May 26 21:26:36.524863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 379/738] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:36.626933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:36.627480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:36.634111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.634560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.635328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:36.636279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:36.797628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:36.805806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f50c2a7-fa4d-4df5-b5a1-988a50622e1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.182776 May 26 21:26:36.806382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 360/739] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:37.179836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:37.181132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:37.181314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:37.182287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:37.189605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.190058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.190410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.190991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.191130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.191506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.191928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.192391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.397956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.401090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.407933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.409316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-82d6163a-cc76-4c4c-b756-7d01e40e2ef3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.231897 May 26 21:26:37.409471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.410562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7714ae53-f4cc-4f1c-8736-acf6ff223bd9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.234913 May 26 21:26:37.412621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 380/740] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:37 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:37.415574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:37.416354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:37.422945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.423988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.424127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 361/741] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:37.424563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.425218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.543540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:37.544171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:37.550843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.551309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.552154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.552608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.560509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.568228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-19dc3bed-16ae-4970-aafc-fb96f205d213 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.156144 May 26 21:26:37.569032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 381/742] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:37 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:37.689757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:37.697364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2b68a41e-1a6b-4682-8411-a6323e98b10b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.158377 May 26 21:26:37.697959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 362/743] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:37.823743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:37.824568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:37.830935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.831473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.832317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.832844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.955622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-bc78e537-d3b1-47df-82fa-f3f7709e35bf req-229527e7-df05-409f-a584-ea82a2c6bac1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "name": "network-vif-plugged", "status": "completed", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:37.967880 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-bc78e537-d3b1-47df-82fa-f3f7709e35bf req-229527e7-df05-409f-a584-ea82a2c6bac1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:37.968331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-bc78e537-d3b1-47df-82fa-f3f7709e35bf req-229527e7-df05-409f-a584-ea82a2c6bac1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:37.980733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-bc78e537-d3b1-47df-82fa-f3f7709e35bf req-229527e7-df05-409f-a584-ea82a2c6bac1 service nova] Creating event network-vif-plugged:f05cef3c-e3f9-4f57-80cb-753ef76b7536 for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 on hv-cinder-82880 May 26 21:26:37.986415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-bc78e537-d3b1-47df-82fa-f3f7709e35bf req-229527e7-df05-409f-a584-ea82a2c6bac1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035910 May 26 21:26:37.987016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 363/744] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:38.011523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.024856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c46ffc81-25d2-476d-b92c-b2f57f885a9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.204801 May 26 21:26:38.025856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 382/745] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:38.426800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:38.427532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:38.431397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:38.432818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:38.434747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.435107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.435850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.436456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.439752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.440096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.441061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.441494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.627866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.632095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:38.636540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2a2d85d0-09d5-40e5-867a-9575bbb04041 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.214012 May 26 21:26:38.637150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 364/746] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:38.642455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.645073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:38.645766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:38.650795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.652268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.652392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.652760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.653505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7acf192c-1d26-45ef-9cb8-f7bed549bd3d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.225971 May 26 21:26:38.653645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.653961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.654072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 383/747] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:38 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:38.714358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:38.714643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:38.716616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:38.722059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.722614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.723575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:38.724009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:38.831777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.839560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d4b0c850-2092-4dfd-ae94-b1cf1ae3aaca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.201380 May 26 21:26:38.840237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 365/748] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:38 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:38.881136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:38.888563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dfbe55d3-5938-400b-90a9-7438e4a8fb32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.178735 May 26 21:26:38.889179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 384/749] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:39.043987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:39.044624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:39.051025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.051476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:39.052250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.053375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:39.182832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:39.190897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1d620a5b-8e4f-42e9-aea1-11baf723a9bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.151416 May 26 21:26:39.191470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 366/750] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:39.654415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:39.656205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:39.662296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.662615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:39.663387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.663819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:39.671852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:39.672810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:39.675546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:39.682903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.683594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:39.684639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:39.685269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.341504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.349419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.350285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.352177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.354004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37893209-731a-4af4-9e89-a91585ba5b77 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.686585 May 26 21:26:40.355502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 367/751] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:39 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:40.359994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:40.360970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:40.364925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3cf2a0c8-cfe8-416e-adbd-bf125a1da510 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.714919 May 26 21:26:40.365776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 385/752] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:39 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:40.368213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.368708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.369481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.370587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.371548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:40.372254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:40.378403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.378990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.379865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.380418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.385937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:40.686870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.694853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-84e6ea0c-5b20-40e6-88bd-b1c1acedb751 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.327893 May 26 21:26:40.695437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 386/753] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:40.700188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:40.700790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:40.707467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.707924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.708811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:40.709254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:40.730389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:40.738862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9ce47497-1711-46d5-a7da-3c362380a621 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.382338 May 26 21:26:40.739577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 368/754] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:40 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:41.132671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.146820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f6410178-30c6-4710-9ac6-effe0d78889f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.450238 May 26 21:26:41.147339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 387/755] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:41.373950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:41.374577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:41.380944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.381398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.382184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.382626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.382753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:41.383247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:41.389966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.390418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.391184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.391919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.657223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.662369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.667299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.668924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.670262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d6ee38f1-3bfe-40b1-a603-3685abcdaf43 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.300837 May 26 21:26:41.670842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 369/756] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:41 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:41.670977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-64251c05-6e48-4329-a158-f9cb9b700924 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.291995 May 26 21:26:41.671570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 388/757] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:41.686342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-1a675fa8-4a98-4f74-b919-6a3b2cc39095 req-b5d9e697-9252-40e8-a6a0-5639771b07d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f68637f-abc4-4cda-8337-006a57db6ffe", "tag": "8003cdb9-293b-47fe-b5a7-55765c01e2ce"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:41.695514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-1a675fa8-4a98-4f74-b919-6a3b2cc39095 req-b5d9e697-9252-40e8-a6a0-5639771b07d5 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.695950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-1a675fa8-4a98-4f74-b919-6a3b2cc39095 req-b5d9e697-9252-40e8-a6a0-5639771b07d5 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.710936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-1a675fa8-4a98-4f74-b919-6a3b2cc39095 req-b5d9e697-9252-40e8-a6a0-5639771b07d5 service nova] Creating event network-changed:8003cdb9-293b-47fe-b5a7-55765c01e2ce for instance 1f68637f-abc4-4cda-8337-006a57db6ffe on hv-cinder-82880 May 26 21:26:41.712202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:41.712894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:41.717097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-1a675fa8-4a98-4f74-b919-6a3b2cc39095 req-b5d9e697-9252-40e8-a6a0-5639771b07d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044962 May 26 21:26:41.717804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 370/758] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:41.719333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.719861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.720545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.721164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.755656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:41.756439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:41.763173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.763720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.764558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:41.765083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:41.914082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.922555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b761105a-3c9f-4c2a-8a97-39635c85e17d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.214239 May 26 21:26:41.923137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 389/759] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:41 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:41.944462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:41.953220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98eab448-a6ac-4d8a-a018-5f2dfcf7dd0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.201107 May 26 21:26:41.954042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 371/760] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:41 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:42.164845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:42.165427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:42.172382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.180382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.180382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.180382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.308612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:42.316531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b23de65-23bd-471e-9a3d-cbf9458a2966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.155693 May 26 21:26:42.317136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 390/761] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:42.688248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:42.693704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:42.694385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:42.697487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:42.702120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.702643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.703696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.704271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.704686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.705335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.706114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.706723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.901873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:42.910501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-68856282-f8f6-430c-bd42-b7012355c1e3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.225954 May 26 21:26:42.910968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 372/762] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:42.916964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:42.923236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:42.924800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:42.930135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-10e39392-72af-473a-9e03-bfc79ea1c700 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.236097 May 26 21:26:42.930135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 391/763] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:42 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:42.949742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:42.950652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:42.957080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.958758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.958758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.958972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.971062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:42.971593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:42.977875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.978329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:42.979133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:42.979759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.174435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:43.183755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4ea53787-c001-4765-a98c-640e8e658765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.238702 May 26 21:26:43.184524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 373/764] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:43.198097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-19b285d4-e230-4dc1-aa11-f2c1eb08b7d1 req-97a99bf8-ffc4-49e4-8159-c38ea5d391cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6ec354-4f9e-406a-80a5-90856a7fead8", "name": "network-vif-plugged", "status": "completed", "tag": "241fdbd4-c846-46aa-a9a2-27a629464f87"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:43.205501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:43.210119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-19b285d4-e230-4dc1-aa11-f2c1eb08b7d1 req-97a99bf8-ffc4-49e4-8159-c38ea5d391cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.210829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-19b285d4-e230-4dc1-aa11-f2c1eb08b7d1 req-97a99bf8-ffc4-49e4-8159-c38ea5d391cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.213871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c704afb7-6828-477b-a78c-8b6eb938854a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.246588 May 26 21:26:43.214797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 392/765] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:42 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:43.227183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-19b285d4-e230-4dc1-aa11-f2c1eb08b7d1 req-97a99bf8-ffc4-49e4-8159-c38ea5d391cf service nova] Creating event network-vif-plugged:241fdbd4-c846-46aa-a9a2-27a629464f87 for instance 0e6ec354-4f9e-406a-80a5-90856a7fead8 on hv-cinder-82880 May 26 21:26:43.233848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-19b285d4-e230-4dc1-aa11-f2c1eb08b7d1 req-97a99bf8-ffc4-49e4-8159-c38ea5d391cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047780 May 26 21:26:43.234794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 374/766] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:43.337715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:43.338360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:43.344570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.345054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.345849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.346291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.533599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:43.542393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-31dd3e3c-65ad-4f26-936e-0dc72a6b3726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.208097 May 26 21:26:43.543113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 393/767] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:43.935236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:43.935236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:43.936335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.937145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.937983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.938428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.950855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:43.951666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:43.960612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.961239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:43.962181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:43.962917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.152617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.160002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.160604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fb9ec086-2452-4945-bb33-ae650b6d0fe9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.236959 May 26 21:26:44.161185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 375/768] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:44.168683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.170202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.171372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-befe5840-8a38-4c0f-90fb-0ca6d58da0b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.225861 May 26 21:26:44.171952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 394/769] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:43 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:44.201671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:44.202204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:44.208339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.208821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.209587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.210024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.230869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:44.231478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:44.237955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.238652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.239451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.239898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.416105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.420409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.424056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31b13835-e252-4733-aa93-f4ed326db3b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.226831 May 26 21:26:44.424808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 376/770] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:44 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:44.427986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8fb2121c-d55d-42e1-9a2b-8902ae0aa897 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.200967 May 26 21:26:44.428544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 395/771] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:44 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:44.560051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:44.566689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:44.567397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.567397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.568122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:44.568552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:44.702427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:44.710556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-be0b487d-5cbb-4c72-9a26-fa8086201209 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.154851 May 26 21:26:44.711209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 377/772] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:45.178456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:45.179081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:45.186723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.190810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.190810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.190810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.191126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:45.191126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:45.198188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.198739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.199598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.200107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.498596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.501576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.506680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5e4d061d-2f87-4025-abee-c57bf42a1c07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.332483 May 26 21:26:45.507263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 396/773] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:45.516799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.516799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.516799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-55482173-c7d8-4b7d-89a4-cbab2058e429 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.328925 May 26 21:26:45.517118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 378/774] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:45 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:45.520572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:45.521525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:45.525261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:45.526727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:45.529654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.530778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.530944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.531356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.534336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.534888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.535892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.536526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.835192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.842947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5a6988b5-4271-4ddd-9c88-0ff16d441209 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.326635 May 26 21:26:45.843549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 379/775] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:45.848317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:45.849374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:45.851317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.855755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.856480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.857292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:45.857893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:45.860117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b835224d-ac77-4a97-96cc-c5235ff89c56 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.341739 May 26 21:26:45.860858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 397/776] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:45 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:45.986120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:45.994162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98fc785f-dbc0-41fa-99cf-7722b5863ea6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.149649 May 26 21:26:45.995235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 380/777] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:46.525118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:46.526649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:46.533885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:46.534886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:46.535251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:46.535831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:46.536766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:46.537321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:46.543765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:46.544371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:46.545424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:46.545930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.316391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.328606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae992587-9ffe-4692-8279-bc3595e14534 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.807574 May 26 21:26:47.340382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 398/778] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:46 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:47.340893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.351403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:47.352390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:47.358928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.363648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.364180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.365457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.366194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.366480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5fad8dd0-8ecb-4795-ae29-2dc1a15eadd5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1745 microversion: 2.20 time: 0.837086 May 26 21:26:47.366906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.368077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 381/779] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:46 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1745 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:47.389104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:47.390984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:47.423226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.424013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.425474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.426383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.687466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.701045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aaffcff7-bd40-467c-95fa-4bf9fd026b0a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.359204 May 26 21:26:47.701910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 399/780] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:47.712563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:47.713971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:47.714201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.723983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.731365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.731365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.731365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.731918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:47.731918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-30365ef6-38f4-49e9-a8f2-02d17d9b15fa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.354733 May 26 21:26:47.740888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 382/781] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:47 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:47.746360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-b7018b89-6248-44fb-9212-e7a97dd37988 req-f963aabe-6a6b-4329-b8f3-b32b694bb1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "name": "network-vif-plugged", "status": "completed", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:47.754856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b7018b89-6248-44fb-9212-e7a97dd37988 req-f963aabe-6a6b-4329-b8f3-b32b694bb1a6 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:47.755295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b7018b89-6248-44fb-9212-e7a97dd37988 req-f963aabe-6a6b-4329-b8f3-b32b694bb1a6 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:47.769321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-b7018b89-6248-44fb-9212-e7a97dd37988 req-f963aabe-6a6b-4329-b8f3-b32b694bb1a6 service nova] Creating event network-vif-plugged:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:26:47.776443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-b7018b89-6248-44fb-9212-e7a97dd37988 req-f963aabe-6a6b-4329-b8f3-b32b694bb1a6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033718 May 26 21:26:47.777579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 383/782] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:47.879839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:47.888120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d1a94c71-99a0-47c4-ac6b-5732013e4c5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.183525 May 26 21:26:47.889498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 400/783] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:48.355032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:48.355779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:48.362526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.362984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.363750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.364184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.404137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:48.404896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:48.411551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.412056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.412873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.413325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.623301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.632332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-466fb1c8-8266-472f-b416-ada19d62e4d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.282479 May 26 21:26:48.641410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 384/784] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:48 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:48.659186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.668506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.670184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.671564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-56da66b4-a576-4831-8886-a87e3c763a70 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.272169 May 26 21:26:48.672250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 401/785] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:48 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:48.726428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:48.727312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:48.734723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.735244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.736153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.736682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.749124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:48.750225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:48.757684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.758418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.759782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:48.761138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:48.977469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.987100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a5c78bec-a9be-44ae-afb2-571bd3f97033 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.264270 May 26 21:26:48.988182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 385/786] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:48 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:48.991732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:48.996930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:48.997670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:48.997976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:49.005489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8240e30f-ac42-415b-96c2-adac0be80faf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.260993 May 26 21:26:49.012535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 402/787] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:48 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:49.012785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.012785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.012785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.012785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.153470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:49.162142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98480a60-c852-4c35-b757-7ca2af077f2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.172364 May 26 21:26:49.162802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 386/788] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:49.651466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:49.652281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:49.660385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.660931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.661732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.662207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.689822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:49.690450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:49.697742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.698201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.698979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:49.699425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:49.887481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:49.898811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cdf720a6-5ae3-4933-9190-11d1232dc189 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.251765 May 26 21:26:49.899027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 403/789] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:49.903136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:49.918511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:49.921478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:49.923749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-469143bc-0680-467a-a6b5-f7f6e715c3e1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.237540 May 26 21:26:49.924838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 387/790] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:49 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:26:50.006155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:50.007279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:50.015029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.015492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.016352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.016886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.032227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:50.032954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:50.039949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.040402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.041276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.041728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.284465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:50.291571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:50.294826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3c43317a-59f3-4f6f-b0f5-5338b85d2fcb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.290410 May 26 21:26:50.301069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 404/791] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:50.306820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-681dd7d2-149d-42e9-a114-a4146fe77772 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.272374 May 26 21:26:50.306820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 388/792] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:50 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:50.307576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:50.307576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:50.309162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.309618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.310397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.310834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.452192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:50.460197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a1f1f9ce-a9a7-4e1c-813e-3b5507592d83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1723 microversion: 2.1 time: 0.162494 May 26 21:26:50.460804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 405/793] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:50.918062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:50.918901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:50.925732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.926190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.926973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.927594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.957787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:50.958439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:50.972695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.973158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:50.973977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:50.974379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.169264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.177811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4eeba2f5-ff92-422e-9c56-85c5e076c4d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1318 microversion: 2.1 time: 0.264208 May 26 21:26:51.182769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 389/794] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:51.198189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.207067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.208783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.210209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7706178e-73c9-4e47-8e9a-a6fd14145a8a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.262235 May 26 21:26:51.210862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 406/795] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:50 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:51.312797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:51.313410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:51.319506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.319960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.320746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.321185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.321608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:51.322226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:51.328743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.329202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.330039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.330514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.541674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.544168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.562565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c5027291-1fd4-4fea-a70a-9b46de3840e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.244727 May 26 21:26:51.563321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 407/796] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:51 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:51.566616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b04605fe-6a98-4e39-a69b-ee0feae003d3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.257721 May 26 21:26:51.567602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 390/797] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:51.573407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:51.573864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:51.584140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.584140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.584322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.585071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.796479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:51.804997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0dbcc983-0483-4b15-9dd2-50f41814634e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1700 microversion: 2.1 time: 0.240756 May 26 21:26:51.805593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 408/798] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1700 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:51.824471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-14bdd9ed-06cf-41be-a59d-97a894ec8ecb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:51.831682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14bdd9ed-06cf-41be-a59d-97a894ec8ecb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:51.832411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-14bdd9ed-06cf-41be-a59d-97a894ec8ecb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:51.898851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-14bdd9ed-06cf-41be-a59d-97a894ec8ecb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Going to try to start instance {{(pid=118355) start /opt/stack/nova/nova/compute/api.py:2730}} May 26 21:26:52.118822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-14bdd9ed-06cf-41be-a59d-97a894ec8ecb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action" status: 202 len: 0 microversion: 2.1 time: 0.297944 May 26 21:26:52.120685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 391/799] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:26:51 2022] POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:26:52.129375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:52.135396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.141745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.142646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.144321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.144808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.203747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:52.207789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.235133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.241739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.245213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.246411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.408779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.427311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-076350ef-22cc-4ed9-b899-1081746c9ba9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1709 microversion: 2.1 time: 0.302163 May 26 21:26:52.427904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 409/800] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1709 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:52.439836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:52.440787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.449431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.449888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.450722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.451165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.534315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.571023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5c6e97f4-f676-4aa6-b3d2-73a7ceab7460 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1506 microversion: 2.1 time: 0.377105 May 26 21:26:52.581752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 392/801] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:52.594767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:52.596238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.611061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.613831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.615753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.616565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.754469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.771162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.778297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.778595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0b54f393-d5f6-4e63-a1a3-e80b47eb9df1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.348955 May 26 21:26:52.781390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 410/802] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:52 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:52.787763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:52.788561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.798436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.799397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.800855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.801698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.927872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:52.944475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-653d8e2a-9f8e-416d-b03c-aa50ac54e676 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.360188 May 26 21:26:52.960184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 393/803] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:52.971871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a936025-6d17-44ff-9e2c-30e1776fec67", "device": "/dev/sdb"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:52.976431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:52.989355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.990865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:52.992636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:52.993854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:53.024452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:53.035807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-99af1f97-4053-441d-b3f5-afeb24b33437 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.254899 May 26 21:26:53.036504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 411/804] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:52 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:53.447649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:53.449785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:53.457643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:53.458355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:53.459336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:53.459944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:53.764354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:53.805268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1c5fc4ec-bd8b-4179-b38f-ed7454593396 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1709 microversion: 2.1 time: 0.361639 May 26 21:26:53.806109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 412/805] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1709 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:53.826247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:53.827150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:53.835327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:53.835836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:53.836700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:53.837260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.082807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:54.095235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:54.096460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:54.097283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-af446bd3-797d-443d-9e6a-7745252183e6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.277850 May 26 21:26:54.109242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 413/806] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:53 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:54.337606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6b3b774c-57ea-4ad1-9837-4f9d1f6fa31e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "POST /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.374677 May 26 21:26:54.345860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 394/807] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:26:52 2022] POST /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments => generated 194 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:54.370543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:54.370543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:54.401818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-b3f1907a-4a91-4af4-b861-645b46ba7ff7 req-c362d8d6-8685-495a-8222-0bddc66b23cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f68637f-abc4-4cda-8337-006a57db6ffe", "name": "network-vif-plugged", "status": "completed", "tag": "8003cdb9-293b-47fe-b5a7-55765c01e2ce"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:26:54.413056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.421509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.423259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.429545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.439260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b3f1907a-4a91-4af4-b861-645b46ba7ff7 req-c362d8d6-8685-495a-8222-0bddc66b23cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.440338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-b3f1907a-4a91-4af4-b861-645b46ba7ff7 req-c362d8d6-8685-495a-8222-0bddc66b23cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.482577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-b3f1907a-4a91-4af4-b861-645b46ba7ff7 req-c362d8d6-8685-495a-8222-0bddc66b23cf service nova] Creating event network-vif-plugged:8003cdb9-293b-47fe-b5a7-55765c01e2ce for instance 1f68637f-abc4-4cda-8337-006a57db6ffe on hv-cinder-82880 May 26 21:26:54.494018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-b3f1907a-4a91-4af4-b861-645b46ba7ff7 req-c362d8d6-8685-495a-8222-0bddc66b23cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.383044 May 26 21:26:54.496066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 414/808] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:54.504911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:54.506162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:54.516636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.517281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.518722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.519343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.718079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:54.728837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4941e2e4-5552-4369-8c43-58b5f3e2abe2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1359 microversion: 2.1 time: 0.380402 May 26 21:26:54.742582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 395/809] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1359 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:54.827489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:54.828118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:54.834448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:54.846274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.849210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.849210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:54.849210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:54.850858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44caa191-bf02-4c48-9a4b-c1ad83b3347b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.353026 May 26 21:26:54.851474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 415/810] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:54 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:55.121914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:55.124486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:55.135261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.136423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:55.138193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.139291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:55.412542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:55.424672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-751e5e95-c56f-4e5c-bde8-d1ad8ca9ba09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1709 microversion: 2.1 time: 0.601398 May 26 21:26:55.425478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 396/811] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1709 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:55.535020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:55.548891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:55.550516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:55.551734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7d17c2d6-6f8d-4508-8045-d95762b26346 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.437992 May 26 21:26:55.552319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 416/812] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:55 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:55.751429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:55.752513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:55.760023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.760719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:55.761566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.762117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:55.890565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:55.892176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:55.903492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.904210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:55.905968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:55.906738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.020068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.025249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:56.036324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7b2ceae6-d5fd-4424-985d-af6dc0741dd2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1547 microversion: 2.1 time: 0.289550 May 26 21:26:56.046372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 397/813] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:55 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1547 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:56.061057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:56.062206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:56.078954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.080456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.081395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.082402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.241037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.274343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ffa62300-2c14-4fde-a43a-0f60ab34aaef tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.395445 May 26 21:26:56.288628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 417/814] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:55 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:56.362918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.381628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0fa998e6-adf9-4903-ae59-e1020fd01b8c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1547 microversion: 2.1 time: 0.329511 May 26 21:26:56.382846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 398/815] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1547 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:56.407157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:56.412556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.413794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Searching by: {'deleted': False, 'project_id': '198b0d7e8b204f858abb8474f90af623'} {{(pid=118354) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 26 21:26:56.423506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.424238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.425904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.426678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.460424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:56.461084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:56.473734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.482496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.483943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.484828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.574502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.multi_cell_list [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118354) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 26 21:26:56.700395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.709572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8675451b-e2fa-4d97-89bc-ef2f9a537e50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1709 microversion: 2.1 time: 0.256530 May 26 21:26:56.711119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 399/816] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1709 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:56.718744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:56.719676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:56.726663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.727453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.728464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f6d3954d-78c2-4145-8705-a94b6ca3fac7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.332893 May 26 21:26:56.728790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.729967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 418/817] 10.222.0.66 () {58 vars in 1124 bytes} [Thu May 26 21:26:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:56.730253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.742377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:56.743345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:56.750824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.751615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.752624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:56.753266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:56.989318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:56.999749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:57.002636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:26:57.005965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-92dd1cf0-b932-4f3d-a113-863aae8290ff tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1547 microversion: 2.1 time: 0.267507 May 26 21:26:57.007459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 419/818] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1547 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:26:57.024206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:57.027373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:57.029090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f98f20af-8fd9-4d1e-bc21-b0e81aa7eccb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.316617 May 26 21:26:57.030587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 400/819] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:56 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:57.308609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:57.309665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:57.347785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:57.348426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:57.349764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:57.350461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:57.654672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:57.677493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-62b75067-3821-45f6-abbf-95cd4b7519ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1367 microversion: 2.1 time: 0.377836 May 26 21:26:57.680700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 420/820] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:57 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1367 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:57.732339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:57.733749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:57.742233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:57.743189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:57.744631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:57.745519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:58.004795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:58.019107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6ed23325-5306-4370-baf3-6b44ada5af23 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1713 microversion: 2.1 time: 0.293161 May 26 21:26:58.020175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 401/821] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1713 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:58.063889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:58.063889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:58.074079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:58.074798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:58.075785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:58.076378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:58.351657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:58.369894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:58.375646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:58.375646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-09f45179-eca1-41a2-ae08-d6bbe38ca37e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.315669 May 26 21:26:58.376280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 421/822] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:58 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:26:58.714715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:58.715883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:58.726053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:58.726844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:58.728204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:58.729158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.001419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:59.019443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-317fcb87-4983-46b3-8b04-14b297ee4d82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1556 microversion: 2.1 time: 0.311936 May 26 21:26:59.020928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 402/823] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:26:58 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:26:59.057121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.059325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:59.071394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.071844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.072700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.073222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.179407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-73a8e0f1-4f7b-4656-b7b8-b49190d7388f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132651 May 26 21:26:59.183925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 422/824] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:26:59.407012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:26:59.411308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:26:59.421573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.422403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.424170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:26:59.425135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:26:59.674523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:59.690292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:59.693592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:26:59.695978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-65a17c51-3696-40e4-8cd6-17a709a0c65c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.301322 May 26 21:26:59.698207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 403/825] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:26:59 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:00.386594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:00.388450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:00.395218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:00.395666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:00.396462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:00.396944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:00.728771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:00.731056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:00.739538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:00.740319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:00.741613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:00.742288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:00.986237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:01.012854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:01.017377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:01.020625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-64eb0404-f44c-4724-a950-cf98ccb72955 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.298416 May 26 21:27:01.034872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 404/826] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:00 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:01.650287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-40f068cb-4b3f-4755-b8af-4215185734c1 req-d7590545-0565-48a1-b940-c370b7eeff15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f68637f-abc4-4cda-8337-006a57db6ffe", "tag": "8003cdb9-293b-47fe-b5a7-55765c01e2ce"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:01.662938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40f068cb-4b3f-4755-b8af-4215185734c1 req-d7590545-0565-48a1-b940-c370b7eeff15 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:01.663815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40f068cb-4b3f-4755-b8af-4215185734c1 req-d7590545-0565-48a1-b940-c370b7eeff15 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:01.682690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-40f068cb-4b3f-4755-b8af-4215185734c1 req-d7590545-0565-48a1-b940-c370b7eeff15 service nova] Creating event network-changed:8003cdb9-293b-47fe-b5a7-55765c01e2ce for instance 1f68637f-abc4-4cda-8337-006a57db6ffe on hv-cinder-82880 May 26 21:27:01.692512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-40f068cb-4b3f-4755-b8af-4215185734c1 req-d7590545-0565-48a1-b940-c370b7eeff15 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222591 May 26 21:27:01.694574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 405/827] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:27:01.811584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2b382491-082e-4cd3-8968-f2a920148024 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.429625 May 26 21:27:01.813128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 423/828] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:27:00 2022] POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments => generated 194 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:02.047343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:02.048287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:02.069850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:02.070206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:02.072123 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:02.073387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:02.578887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:02.607878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:02.614993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:02.627138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71f6e86e-0b33-4995-b8e5-48ca6e282fe2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.586138 May 26 21:27:02.628621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 406/829] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:02 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:03.651821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:03.653994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:03.669923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:03.669923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:03.669923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:03.669923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:03.931079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:03.950960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:03.954165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:03.956096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8382a1d4-d522-4bc0-9ed2-72e5b6fe3307 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.310987 May 26 21:27:03.970284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 424/830] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:03 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:04.988227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:04.989370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:04.997711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:04.998154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:04.998971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:04.999415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:05.192262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:05.201845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:05.203594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:05.204906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aaa6eebd-e021-4a1a-a873-97a6fa3f8812 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.220751 May 26 21:27:05.205511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 407/831] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:04 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:06.225653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:06.226909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:06.237356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:06.237356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:06.237835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:06.238759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:06.404230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:06.413897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:06.415602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:06.417547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bac14b2b-2178-44b9-852d-2cbcef0893d9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.197142 May 26 21:27:06.418192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 425/832] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:07.438288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:07.439142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:07.447061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:07.447640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:07.448475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:07.448959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:07.630128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:07.638832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:07.640398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:07.641650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d59d22d1-4a44-4108-801b-7588483b4a41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1740 microversion: 2.20 time: 0.208325 May 26 21:27:07.642233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 408/833] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:07 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:08.661780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:08.662531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:08.664561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:08.671375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:08.671829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:08.680658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:08.680658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:08.847640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:08.857076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:08.858619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:08.859832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-be71d900-e3ae-4c38-9cee-88514afdcf89 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.202107 May 26 21:27:08.860423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 426/834] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:08 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:09.879968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:09.880757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:09.883452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=84 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:09.889462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:09.895995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:09.895995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:09.895995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:10.057959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:10.068664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:10.070819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:10.072474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de08cfc8-5e20-478c-8c20-3539e03fcb4a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.196684 May 26 21:27:10.073894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 409/835] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:09 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:11.094028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:11.094660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:11.097341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=86 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:11.102921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:11.103408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:11.104796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:11.105245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:11.513713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:11.522558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:11.524107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:11.525462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f8b43a2c-37a0-41ca-b87c-4ef86cbff5f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.435494 May 26 21:27:11.526576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 427/836] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:11 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:11.826152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-87b4ccd3-a1b0-417e-b19c-ac0c09ea7ced req-b0a40e69-e364-43e6-9f12-02c17c9a7d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "name": "network-vif-unplugged", "status": "completed", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:11.835676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-87b4ccd3-a1b0-417e-b19c-ac0c09ea7ced req-b0a40e69-e364-43e6-9f12-02c17c9a7d20 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:11.836227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-87b4ccd3-a1b0-417e-b19c-ac0c09ea7ced req-b0a40e69-e364-43e6-9f12-02c17c9a7d20 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:11.849560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-87b4ccd3-a1b0-417e-b19c-ac0c09ea7ced req-b0a40e69-e364-43e6-9f12-02c17c9a7d20 service nova] Creating event network-vif-unplugged:f05cef3c-e3f9-4f57-80cb-753ef76b7536 for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 on hv-cinder-82880 May 26 21:27:11.855405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-87b4ccd3-a1b0-417e-b19c-ac0c09ea7ced req-b0a40e69-e364-43e6-9f12-02c17c9a7d20 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033582 May 26 21:27:11.856102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 410/837] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:27:12.546097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:12.546723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:12.554089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:12.554543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:12.555346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:12.555791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:12.720993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:12.731708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:12.733301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:12.734524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-503a0564-4ea1-412d-9e46-7797f118d23c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.193345 May 26 21:27:12.735108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 428/838] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:12 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:13.755017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:13.755737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:13.763336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:13.763785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:13.764694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:13.765077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:13.920558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:13.929737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:13.931312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:13.933232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5cd86328-aafa-4ce0-bcbf-e1b841c6fda7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.183447 May 26 21:27:13.934057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 411/839] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:13 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:14.960724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:14.961482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:14.970123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:14.974841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:14.974841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:14.974841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:15.132886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:15.142618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:15.144192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:15.145596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-08f2bd58-0922-44c9-ab2b-2f96b7999dff tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.189128 May 26 21:27:15.146384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 429/840] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:14 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:16.175451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:16.176071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:16.184094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:16.184566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:16.185390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:16.185833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:16.354120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:16.363545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:16.365199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:16.366447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ddf1f12c-b3f9-4aed-901f-6728b99e8136 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.195218 May 26 21:27:16.367033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 412/841] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:16 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:17.386869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:17.387708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:17.394779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:17.395293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:17.396303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:17.396852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:17.570335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:17.580440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:17.582150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:17.583397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-46c27f99-c277-43dc-8b92-073b2eccd060 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.201358 May 26 21:27:17.584017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 430/842] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:17 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:18.604468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:18.605129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:18.612053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.612508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.613343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:18.613787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:18.771265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:18.783763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:18.785835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:18.787224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dd2146cb-a238-40ee-b8f7-0ebf83c6d323 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.187440 May 26 21:27:18.787810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 413/843] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:18 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:19.807767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:19.808517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:19.816065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:19.816520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:19.817345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:19.817787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:19.983846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.992765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.995037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:19.996343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7d0535bf-e322-4fa3-baec-a96bf98569b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.193455 May 26 21:27:19.997051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 431/844] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:19 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:21.016006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:21.016683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:21.024092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.024654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.025932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:21.026388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:21.218161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.228396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.231530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:21.233318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2d9e2ebd-c224-4a92-9da1-06d6276c2553 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.221622 May 26 21:27:21.234061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 414/845] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:21 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:22.261236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:22.261848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:22.269370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:22.269858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:22.270658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:22.271109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:22.423400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.436974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.440333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:22.442555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8e7f93fb-b58f-4ad9-96f6-2e6a214d600d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.185140 May 26 21:27:22.448827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 432/846] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:22 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:23.466057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:23.466744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:23.474354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:23.474806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:23.475605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:23.476047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:23.794280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:23.798232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:23.803657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:23.805248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:23.808760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c7e3655-16cb-4cd9-978b-2e6bc0425438 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.344695 May 26 21:27:23.808760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 415/847] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:24.830011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:24.831103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:24.841627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.842134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.842986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:24.843425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:24.981161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.989298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.990810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:24.991983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4796404-44d6-4c8b-8c80-3a00d78690b0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.169445 May 26 21:27:24.992554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 433/848] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:26.011911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:26.012653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:26.019548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.020008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.020843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:26.021287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:26.164123 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.174326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.175820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:26.177029 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc56bb2c-4e2b-4924-85a4-671a20178aa1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.170083 May 26 21:27:26.177596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 416/849] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:26 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:27.204473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:27.205346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:27.212782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.213763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:27.214558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:27.214997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:27.357078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:27.359342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:27.366326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:27.367843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:27.369085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-02b0edf8-ffe8-49ad-883f-710e25a73d45 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.168645 May 26 21:27:27.374517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 434/850] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:27 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:28.386998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:28.387672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:28.395608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.396105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.396992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:28.397505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:28.586820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.595994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.597554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:28.598828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5a0c21d-ff02-4952-a170-1f6813f13d1a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.215967 May 26 21:27:28.599393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 417/851] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:28 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:29.618506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:29.619741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:29.627607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.628061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.628897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:29.629340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:29.796637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.811699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.813831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:29.815915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e2d2040-eb4c-405b-a4a2-88f4923212d1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.201282 May 26 21:27:29.816992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 435/852] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:29 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:30.844627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:30.845517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:30.852448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.852981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:30.853828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:30.854271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:31.001965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.018380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.020811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:31.022994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4f0526ae-4d20-44d1-a3f2-f32b5062c785 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.182298 May 26 21:27:31.024038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 418/853] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:30 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:32.050607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:32.051267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:32.058884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.059344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.060147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.060625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.214959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.223952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.225522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:32.226741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6a23fb21-a6d2-49f3-89ca-3736af964c79 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.180228 May 26 21:27:32.227314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 436/854] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:32 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:32.581103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49206d50-43fa-41d8-b7dd-5c5953ea2174"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:27:32.583031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:32.593726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.594516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:32.595896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:32.596693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.246594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:33.247211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:33.254384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.254839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.255620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:33.256061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:33.403405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.412528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.414072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:33.415328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-574c8e77-2097-416f-bd1a-e4957af66828 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.173149 May 26 21:27:33.416452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 437/855] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:33 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:34.434329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:34.435106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:34.441775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.442235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.443050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:34.443494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:34.594152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.602854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.604382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:34.605599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d47cc114-6864-4f5c-971f-36e3066a7b30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.175437 May 26 21:27:34.606167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 438/856] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:34 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:35.623728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:35.624483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:35.631412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.631868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.632680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:35.633126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:35.769279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:35.778067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:35.779592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:35.781081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-88c13c12-9da0-48d0-8bc9-d27d10da6dc7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.161391 May 26 21:27:35.781645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 439/857] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:35 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:36.799406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:36.800043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:36.806822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.807275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.808051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:36.808490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:36.960284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.969160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.970685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:36.971873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e3d5364c-0f19-432a-a284-798c66583be5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.176445 May 26 21:27:36.972439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 440/858] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:36 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:37.991124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:37.991809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:37.999199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:37.999644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.000411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:38.000868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:38.139893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.151754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.155048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:38.157150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2197343c-b9ac-4d6c-87d0-d049379bc38f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.169745 May 26 21:27:38.158055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 441/859] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:37 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:39.185489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:39.186184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:39.192872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.193333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.194117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:39.194565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:39.342037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.349890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.351410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:39.352560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b2285ca9-8242-4e60-a333-5092179c4316 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.171117 May 26 21:27:39.353132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 442/860] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:39 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:40.373805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:40.374741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:40.382204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.382709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.383466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:40.383911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:40.569607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.585311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.589142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:40.590683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eb6c420c-75af-44dc-a617-548291817b56 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.222552 May 26 21:27:40.591514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 443/861] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:40 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:41.610663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:41.611307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:41.613594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=34 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:41.619821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.624175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.624175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:41.624175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:41.759696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.768264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.769837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:41.773139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b6a8ab2-bc10-4b9f-b0aa-03d71ef6d64a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.164331 May 26 21:27:41.773139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 444/862] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:41 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:42.589052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=21 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:42.681215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=24 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:42.789996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:42.790558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:42.797348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.797837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.798618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:42.799062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:42.937325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.945246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.946769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:42.948562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d423e37b-205b-4975-a086-86cc8e3de2c5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.162613 May 26 21:27:42.949154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 445/863] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:42 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:43.967425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:43.968083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:43.974870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.975329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:43.976114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:43.976554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:44.110122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.118674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.120179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:44.121378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f05d0493-5d99-43d0-a3a7-a71948cacf02 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.158516 May 26 21:27:44.121981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 446/864] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:43 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:45.139966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:45.140730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:45.147251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.147709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.148480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:45.148944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:45.286639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:45.296096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:45.297655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:45.298825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8ea8c4be-92e4-4b0d-a820-eba6e5badb51 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.163361 May 26 21:27:45.299388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 447/865] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:45 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:46.316861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:46.317675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:46.324614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.325076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.325871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:46.326315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:46.477949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.486881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.488393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:46.489610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-abac8aac-8557-4ec1-aa2f-d15df2d7180e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.176807 May 26 21:27:46.490181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 448/866] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:46 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:47.507883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:47.508667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:47.515746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.516200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.517006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:47.517452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:47.655128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.664110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.666175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:47.667339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b760ca00-5bac-4e66-9939-30e233dec897 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.163646 May 26 21:27:47.667934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 449/867] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:47 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:48.686024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:48.686741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:48.693818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.694275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.695051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:48.695486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:48.831531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.839723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.841278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:48.842443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2739c1d4-1f35-4618-8711-312c2c34f089 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.160458 May 26 21:27:48.842999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 450/868] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:48 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:27:49.861171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:49.861815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:49.868661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.869124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.869991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:49.870434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:49.886105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:27:50.010911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:50.019346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:50.020901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:50.022087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b0e96cbc-c43b-46c4-a229-ba5e0371a920 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.165014 May 26 21:27:50.022651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 451/869] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:49 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:51.041642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:51.042905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:51.049940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.050387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.051165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:51.051596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:51.191794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.200199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.201754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:51.202941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f6662b8d-8477-4292-b079-d519aa41658b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.165349 May 26 21:27:51.203504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 452/870] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:51 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:52.221950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:52.222628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:52.230857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.231657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.233051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:52.233847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:52.372826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.383118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.384659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:52.385875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5beee06b-8345-4cd3-9bdc-fcb7b71bb345 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.167969 May 26 21:27:52.386432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 453/871] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:52 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:53.404361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:53.405339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:53.412221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.412720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.413513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:53.413956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:53.558853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.567359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.568890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:53.570053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-caf6de12-219b-4c1a-bc54-025ae4cd232c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.169658 May 26 21:27:53.570605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 454/872] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:53 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:54.590407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:54.591076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:54.597771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.598227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.598995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:54.599442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:54.741931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.752524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.754724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:54.755930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc72db71-bf8b-42b2-88d1-0b10b1b4a4b5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.169983 May 26 21:27:54.756812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 455/873] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:54 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:55.776985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:55.777680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:55.784432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.784917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.785684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:55.786117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:55.923136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.931543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.933736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:55.935028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c7fa02e5-530f-453c-9c43-f5f9b41bb96b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.162520 May 26 21:27:55.935589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 456/874] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:55 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:56.954116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:56.954775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:56.961409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.961869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:56.962650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:56.963092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:57.099126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.107662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.109937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:57.111196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-efe2e038-41ee-4183-a9d2-f1bcfd66aac5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.161095 May 26 21:27:57.112216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 457/875] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:56 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:58.130970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:58.131677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:58.138890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.139330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.140168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:58.140624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:58.289467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.297869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.308181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:58.309512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-331ea8b8-0337-40c5-9194-3214bee6afb2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.182574 May 26 21:27:58.310097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 458/876] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:58 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:27:59.328692 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:27:59.329465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:27:59.336006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.340642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.340642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:27:59.340642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:27:59.487392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.498456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.505554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:27:59.505554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-134e6d32-6e01-47ef-90c3-7a88dc8e1343 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.176409 May 26 21:27:59.505554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 459/877] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:27:59 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:00.522043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:00.522748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:00.530015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.530472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.531253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:00.531692 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:00.664502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.673450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.675016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:00.676197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f5c75b20-b867-40f7-b4eb-e97856cff583 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.158111 May 26 21:28:00.676796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 460/878] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:00 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:01.695370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:01.696071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:01.703312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.703830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.704547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:01.705013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:01.844690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.853105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.855226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:01.856424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3a3568dc-c9e9-42ff-aeff-0a41366262a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.165023 May 26 21:28:01.857022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 461/879] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:01 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:02.874918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:02.875614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:02.882316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.882766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:02.883544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:02.885069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:03.112159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.122054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.123565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:03.125016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-97d21b11-53b8-4b92-947d-6c5056b30238 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.254242 May 26 21:28:03.125737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 462/880] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:02 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:03.507306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ff8c2c9-d62c-4fa6-a0a9-d65ac70f680c tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "POST /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 31.048712 May 26 21:28:03.507942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 419/881] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:27:32 2022] POST /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7/os-volume_attachments => generated 194 bytes in 31051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:04.144898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:04.145628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:04.152633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.154791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.155842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.156450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.317522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.325995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.327507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:04.328754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b0de3286-91fe-4510-89c2-386ec5ee9e31 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.187745 May 26 21:28:04.329323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 463/882] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:04 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:04.896188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:04.897892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:04.908246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.909110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:04.910502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:04.911297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.066743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.075772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bf332185-6176-4127-a371-17ad5e1695b3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1593 microversion: 2.1 time: 0.188500 May 26 21:28:05.076381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 420/883] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1593 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:05.347790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:05.348457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:05.355426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.355885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.356696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:05.357139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:05.608072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.617297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.619047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:05.621077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ec49b2c3-c8df-41cd-aa5e-edca06bf370f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1722 microversion: 2.20 time: 0.277381 May 26 21:28:05.622265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 464/884] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:05 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:06.640724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:06.641348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:06.647886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.648338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.649139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.649580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.866930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.882359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.883889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:06.885204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2d1b039d-9432-4772-aed5-88242094101c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1665 microversion: 2.20 time: 0.248677 May 26 21:28:06.886386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 421/885] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1665 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:06.906516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7fd86ef3-bd9d-42ad-8bc0-2f4279cbaca7"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:06.907655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:06.914816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.915338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:06.916064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:06.916567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.834505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-c4809ba7-6ab5-41c6-ab1a-56c3b38658b8 req-b1197e10-270b-45ec-bff0-754f1c7326fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:07.844845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-c4809ba7-6ab5-41c6-ab1a-56c3b38658b8 req-b1197e10-270b-45ec-bff0-754f1c7326fa service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:07.845679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-c4809ba7-6ab5-41c6-ab1a-56c3b38658b8 req-b1197e10-270b-45ec-bff0-754f1c7326fa service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:07.859994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-c4809ba7-6ab5-41c6-ab1a-56c3b38658b8 req-b1197e10-270b-45ec-bff0-754f1c7326fa service nova] Creating event network-changed:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:28:07.865265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-c4809ba7-6ab5-41c6-ab1a-56c3b38658b8 req-b1197e10-270b-45ec-bff0-754f1c7326fa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034728 May 26 21:28:07.869535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 422/886] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:08.028228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:08.119574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a6823952-f141-4881-9414-2865c89634b1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.217270 May 26 21:28:08.120379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 465/887] 10.222.0.66 () {62 vars in 1363 bytes} [Thu May 26 21:28:06 2022] POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments => generated 188 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:28:08.309661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:08.310553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:08.321815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.321815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.321815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.321815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.709218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dead4ffc-37bf-4cf0-aa63-26427269a74b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/action" status: 202 len: 0 microversion: 2.20 time: 0.404706 May 26 21:28:08.714306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 423/888] 10.222.0.66 () {62 vars in 1318 bytes} [Thu May 26 21:28:08 2022] POST /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:28:08.730691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:08.731530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:08.739305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.739759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.740528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:08.740988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:08.947241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.959935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.963309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:08.965697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-73c73bf5-ff29-426b-a687-7b1f939de9ec tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1751 microversion: 2.20 time: 0.249397 May 26 21:28:08.967104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 466/889] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:08 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1751 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:09.985332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:09.985936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:09.995090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.995549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:09.996336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:09.996977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.171469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.188353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.190156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:10.191366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d83d69a5-bb66-47ba-b169-bf5b142009de tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1751 microversion: 2.20 time: 0.210062 May 26 21:28:10.192155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 424/890] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:09 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:10.641131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1807330355"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:10.641809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:10.648870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.649325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.650100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:10.650535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:10.789555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.network.security_group_api [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Adding security group 291efedd-4b06-4c77-bf9a-036031f95b2a to port 030ae099-94fa-4bf1-83eb-d3e51b6ea090 May 26 21:28:11.219669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:11.221090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:11.231263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.232271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.233441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.234206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.347289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-673490c6-f93d-4292-9283-acb45e543c36 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.710515 May 26 21:28:11.348448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 467/891] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:28:10 2022] POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:28:11.360373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:11.361396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:11.377235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.380004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.381621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.382339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.528317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.543569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.545523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.547093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e155a97b-9c8e-4fbc-982d-5d7623b1c715 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.331629 May 26 21:28:11.559264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 425/892] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:11 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:11.565163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-92e25481-8838-4b24-a726-571471ed49e3 req-34cd5c92-a5fb-49b5-8768-19c23b3e6c08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:11.575973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-92e25481-8838-4b24-a726-571471ed49e3 req-34cd5c92-a5fb-49b5-8768-19c23b3e6c08 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:11.576732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-92e25481-8838-4b24-a726-571471ed49e3 req-34cd5c92-a5fb-49b5-8768-19c23b3e6c08 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:11.596083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-92e25481-8838-4b24-a726-571471ed49e3 req-34cd5c92-a5fb-49b5-8768-19c23b3e6c08 service nova] Creating event network-changed:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:28:11.601872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-92e25481-8838-4b24-a726-571471ed49e3 req-34cd5c92-a5fb-49b5-8768-19c23b3e6c08 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041064 May 26 21:28:11.603220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 426/893] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:28:11.688770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:11.697354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6650116d-baad-4251-a33c-74df330c3315 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1758 microversion: 2.1 time: 0.341435 May 26 21:28:11.698513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 468/894] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1758 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:12.567601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:12.568349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:12.575350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.576103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.576960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:12.577403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:12.724073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.734444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.735957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:12.737258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-859f9dd3-20ad-4952-a6c5-212e6b0ebf30 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.174661 May 26 21:28:12.737834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 427/895] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:12 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:13.761592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:13.762699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:13.766668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:13.775515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.776335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.777791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:13.778594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:13.929331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.938698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.940221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:13.941438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-80b9a379-748e-482a-acce-b987e7226c13 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.187963 May 26 21:28:13.942000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 469/896] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:13 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:14.960160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:14.961088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:14.968016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.968510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:14.969387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:14.969872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:15.108004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.117415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.118929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:15.120781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b4327217-60db-4d91-921f-ac2c740c655b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.164603 May 26 21:28:15.121340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 428/897] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:14 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:16.139900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:16.140509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:16.147230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.147681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.148453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:16.148927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:16.286250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.295324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.296878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:16.298072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-02f1bd4c-2343-41e8-a954-418f664fb0f3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.162051 May 26 21:28:16.298636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 470/898] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:16 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:17.319245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:17.319902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:17.326907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.327359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.328140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.328610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.470968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.480696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.482378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:17.483575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a6c3edcc-0de0-474a-a4f5-577e2c9463a9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.168410 May 26 21:28:17.484466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 429/899] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:17 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:17.720507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:17.721035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:17.727426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.727885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.728755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:17.729203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:17.778441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:28:18.079310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d9954219-5cce-498e-a744-cc170f70cb3f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 204 len: 0 microversion: 2.1 time: 0.484741 May 26 21:28:18.080222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 471/900] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:28:17 2022] DELETE /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:28:18.089788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:18.093394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:18.097003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.097446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.098225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.098659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.239168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.246832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cfe41714-10b4-4fbe-98c3-93421264ee82 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1579 microversion: 2.1 time: 0.161588 May 26 21:28:18.247401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 430/901] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:18 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:18.510722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:18.511958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:18.518241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.519166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.519458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:18.519898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:18.664363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.678683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.680727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:18.682013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-45fbc344-5629-454c-8fca-38f8b6dc94b7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.175597 May 26 21:28:18.682668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 472/902] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:18 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:19.265896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:19.266686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:19.273943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.274388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.275172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.275632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.427466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.436633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9eff59c6-7b7c-4b35-b41f-dc7427b1d754 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1579 microversion: 2.1 time: 0.174679 May 26 21:28:19.437915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 431/903] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:19 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:19.700568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:19.701172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:19.707996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.708444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.709253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:19.709703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:19.875957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.884760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.886270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:19.887997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95a2a2bb-5631-415d-aecc-06b73f705952 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.191484 May 26 21:28:19.888568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 473/904] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:19 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:20.455756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:20.456406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:20.464236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.464733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.465649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.466178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.875008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:20.884379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5d311c27-eb21-4172-8b6d-0909106777cd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1579 microversion: 2.1 time: 0.432670 May 26 21:28:20.885014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 432/905] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:20 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1579 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:20.908265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:20.908975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:20.916335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.916822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:20.918306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:20.918602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.334768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:21.345234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:21.347109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:21.348349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-427b1866-7b73-4c8a-aff1-b1f6699ab3d5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.444305 May 26 21:28:21.348951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 474/906] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:20 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:21.741405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-ea780db5-f187-4aa0-bbc4-e0b21b709e26 req-5a9eba89-4637-4403-92df-5c0a6e779b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c7120fd-a7b6-4fda-b546-794e1162ca96", "name": "network-vif-deleted", "tag": "cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:28:21.751882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ea780db5-f187-4aa0-bbc4-e0b21b709e26 req-5a9eba89-4637-4403-92df-5c0a6e779b1f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.752348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ea780db5-f187-4aa0-bbc4-e0b21b709e26 req-5a9eba89-4637-4403-92df-5c0a6e779b1f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.765780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-ea780db5-f187-4aa0-bbc4-e0b21b709e26 req-5a9eba89-4637-4403-92df-5c0a6e779b1f service nova] Creating event network-vif-deleted:cc6e018b-d09f-4d67-a3c4-bbcdbdf2caef for instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 on hv-cinder-82880 May 26 21:28:21.771646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-ea780db5-f187-4aa0-bbc4-e0b21b709e26 req-5a9eba89-4637-4403-92df-5c0a6e779b1f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033967 May 26 21:28:21.772416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 433/907] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:28:21.903456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:21.908185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:21.919085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.920344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:21.921437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:21.922049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.165221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.174160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-34d3448a-e718-4513-aafe-8568d5a4b955 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1512 microversion: 2.1 time: 0.275269 May 26 21:28:22.174752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 475/908] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:21 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1512 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:22.369943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:22.372210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:22.379731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.380302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.381127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:22.381569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:22.551139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.567651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.569251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:22.570605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98697420-5f0c-418e-a3f9-7dfa627e3ffd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.206432 May 26 21:28:22.571192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 434/909] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:22 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:23.202964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:23.203581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:23.210719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.211167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.212047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.212487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.290141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.303819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e6641592-7dc1-4ea1-80c4-fad05ebadf71 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.105598 May 26 21:28:23.304847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 476/910] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:23 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:23.600529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:23.601717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:23.614334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.615127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.616529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:23.617372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:23.802856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.813760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.814422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:23.815632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c2f56769-17a0-48b3-a345-8daf690a766f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.222720 May 26 21:28:23.816215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 435/911] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:24.323872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:24.325064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:24.335044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.335551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.336560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.337286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.409189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:24.418588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aa655cce-deaf-45ca-88b2-d8faf4f27f72 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.100133 May 26 21:28:24.419172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 477/912] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:24 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:24.835144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:24.835729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:24.842973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.843416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.844179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:24.844651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:24.849186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:24.998698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:25.007711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:25.009532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:25.010563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9c484633-a430-4955-a16f-76739666a092 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.179702 May 26 21:28:25.011524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 436/913] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:25.437398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:25.438719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:25.448101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:25.448749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:25.450576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:25.451602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:25.526470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:25.535449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-862a349a-5dfb-466e-9c86-c096be050f22 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.103174 May 26 21:28:25.536032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 478/914] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:25 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:26.034198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:26.035126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:26.046204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:26.048188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.048188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:26.048188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.193686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:26.203454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:26.205040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:26.206262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f0acf0b2-b290-4c2e-a125-375685d97e91 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.180519 May 26 21:28:26.206839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 437/915] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:26 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:26.554988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:26.555824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:26.562925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:26.563376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.564240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:26.564725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:26.650192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:26.659327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1dc6bc55-e956-4112-b450-b131fc6640f1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.108290 May 26 21:28:26.659924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 479/916] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:26 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:27.229938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:27.231301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:27.243359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.244172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.245576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.246840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.441941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:27.451656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:27.453200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:27.454384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4ea2d31-05db-4eef-94b9-69d685b2d07d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.232304 May 26 21:28:27.454944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 438/917] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:27 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:27.682811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:27.683673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:27.690856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.691307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.692098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:27.692540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:27.759538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:27.762092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:27.769089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b84e8c38-80a9-446d-89ac-34f01fb32ba3 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.093381 May 26 21:28:27.769691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 480/918] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:27 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:28.473140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:28.473763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:28.481310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.481756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.482545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.482982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.642309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:28.651804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:28.653894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:28.655361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d67c0c49-0eb7-4704-ac40-fdbd0b7435f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.186280 May 26 21:28:28.655941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 439/919] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:28 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:28.787489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:28.788157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:28.796134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.796609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.797393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:28.797827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:28.866214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:28.874218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-84dccac9-d11e-4e2e-a1f4-593af373881b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.091164 May 26 21:28:28.874809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 481/920] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:28 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:29.675075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:29.675710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:29.682828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.684304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.685724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.686283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.855253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.869344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.872204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.874482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2281d2d6-cbc1-419d-af0c-58d629990112 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.203264 May 26 21:28:29.875465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 440/921] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:29 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:29.892149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:29.892809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:29.899635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.900085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.900908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:29.901345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:29.968177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:29.975809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-21d4aad4-8cbc-4ace-9ee3-5f497c00a0b4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.087536 May 26 21:28:29.976391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 482/922] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:29 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:30.893439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:30.893998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:30.900828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.901291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:30.902829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:30.903268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:30.996621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:30.997513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:31.005514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:31.006107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:31.007010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:31.007576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:31.056483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.066004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.067531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.068853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6cb311a8-fbb2-4de1-9c2f-44404466e025 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.179446 May 26 21:28:31.069470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 441/923] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:30 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:31.083999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:31.092379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1fcc6645-9c7e-4f4f-bac1-6679ddd2de62 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.102155 May 26 21:28:31.101501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 483/924] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:30 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:32.089016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:32.090608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:32.098782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.099232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.100160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.100637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.117472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:32.118168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:32.129664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.131268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.131845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:32.132473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:32.232372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:32.240607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b8330091-16fe-425d-b799-f06c14b76e26 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.128081 May 26 21:28:32.241206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 484/925] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:32 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:32.266463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:32.275693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:32.277408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:32.278624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5805b18a-7913-44bc-b86d-223bcd55174a tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.194231 May 26 21:28:32.279206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 442/926] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:32 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:33.262272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:33.262887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:33.269756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.270208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.270985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.271432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.306620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:33.307489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:33.310514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=49 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:33.315739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.316192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.317082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:33.317533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:33.341402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.350007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9ba0fc8d-0d8e-48a6-b585-c49bd386ed57 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.092398 May 26 21:28:33.350609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 485/927] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:33 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:33.461689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.471139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.472731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:33.473957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f0df46f3-c244-40b2-9637-a6d70ce4e30e tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.172427 May 26 21:28:33.474526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 443/928] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:33 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:34.367561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:34.368312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:34.375201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.375662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.376441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.376908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.443863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.452402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44fd72c1-4b0c-4bc5-bdb8-7fc50ea8a742 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.088692 May 26 21:28:34.453010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 486/929] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:34 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:34.494669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:34.495287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:34.502529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.503059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.503848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:34.504290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:34.650408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.660014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.661652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:34.662832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b98dbe15-f996-49ce-b729-b801eb04e192 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.172230 May 26 21:28:34.663415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 444/930] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:34 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:35.470065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:35.470677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:35.477575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.478020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.478804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.479246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.549235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:35.557511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-609ba7e0-4310-491e-a448-2e5ebb7ac1a7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.091403 May 26 21:28:35.558871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 487/931] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:35 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:35.682824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:35.683637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:35.691102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.691555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.692341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:35.692808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:35.834222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:35.844059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:35.845702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:35.846893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1e64d5b7-4ed2-4e3c-a143-913f098dea2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.168859 May 26 21:28:35.847480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 445/932] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:35 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:36.575510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:36.576130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:36.582908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.583364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:36.584140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.584597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:36.648359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:36.657172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d792c2bb-ef9c-4f4e-8a48-b2c7d0514cfd tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.086148 May 26 21:28:36.657768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 488/933] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:36 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:36.866556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:36.867139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:36.874468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.874921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:36.875702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:36.876145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:37.016505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:37.025649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:37.027750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:37.029012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-39eb05fa-7381-440d-bd5c-f96a1e9c7fd2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.166513 May 26 21:28:37.029871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 446/934] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:36 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:37.674398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:37.675104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:37.681917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:37.682369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:37.683705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:37.684295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:37.753590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:37.762029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a0a4cc50-1927-42b6-82a4-7864e36c56b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.091048 May 26 21:28:37.762628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 489/935] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:37 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:38.047956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:38.051517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:38.055736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.056188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.056999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.057443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.188684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:38.197545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:38.199679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:38.200901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cf69afa8-81f0-4530-bd1a-911ea6e6d20d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.157161 May 26 21:28:38.201468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 447/936] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:38 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:38.780991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:38.781605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:38.788661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.789027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.789824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:38.790270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:38.855604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:38.863942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5602e78d-a69f-44b0-a159-ac0d19d57ea1 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.088188 May 26 21:28:38.864536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 490/937] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:38 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:39.218710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:39.219260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:39.225777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.226224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.226975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.227405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.363886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:39.373550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:39.375096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:39.376278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-56fe08d1-c3c7-4d8a-9674-ead50a4f38f7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.161527 May 26 21:28:39.376898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 448/938] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:39 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:28:39.849436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:39.850014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:39.856891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.857421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.858181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.858616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.881301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:39.882043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:39.888770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.889221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.889994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:39.890436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:39.955221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:39.964224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7534fd97-a9e1-41b8-99fd-e145ca6dce4a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.086689 May 26 21:28:39.964840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 449/939] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:39 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:40.394696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:40.395396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:40.402383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.406282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:40.406282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.406282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:40.538246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:40.548385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:40.550041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:40.551243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cb84b2cc-b049-4f3a-ada0-4c0ec3755ae8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.160439 May 26 21:28:40.551816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 450/940] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:40 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:40.982757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:40.983381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:40.989952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.990410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:40.991195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:40.991633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:41.060103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:41.068069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-77640a30-5c2c-4d46-a820-13044837697c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.089867 May 26 21:28:41.068674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 451/941] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:40 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:41.569606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:41.570255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:41.578435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:41.578910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:41.579722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:41.580139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:41.722734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:41.726547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:41.739343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:41.741815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:41.742117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-58b7e280-b90f-41d0-8df1-2ed97289d8c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.176455 May 26 21:28:41.742712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 452/942] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:41 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:42.085188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:42.085805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:42.092379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.092856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.093629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.094064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.163363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:42.171019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2fd21a17-4666-4294-bcd2-7db4b73aebc2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.089756 May 26 21:28:42.171582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 453/943] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:42 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:42.760805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:42.761535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:42.768360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.768852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.769647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:42.770085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:42.909689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:42.919105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:42.920660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:42.921868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d0852384-63a3-49e9-8ebc-c35cf94bc9fb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.165078 May 26 21:28:42.922471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 454/944] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:42 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:43.188296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:43.188841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:43.194858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:43.195301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:43.196060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:43.196525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:43.257632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:43.265487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-29a09330-5af3-47e1-9c13-98298066add4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.081241 May 26 21:28:43.266046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 455/945] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:43 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:43.941626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:43.942276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:43.950783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:43.951237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:43.952021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:43.952460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:44.084240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:44.092866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:44.094369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:44.095561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f79ebdcc-595a-4603-8f99-c6551a470e2c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.157998 May 26 21:28:44.096099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 456/946] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:43 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:44.282196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:44.282804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:44.288837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:44.289276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:44.290025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:44.290452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:44.354745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:44.362178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c3e3b949-d65a-471b-ab26-f0ac8d832568 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.084086 May 26 21:28:44.362740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 457/947] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:44 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:45.113924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:45.114614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:45.121184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.121627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.122429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.122860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.251536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:45.260087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:45.261631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:45.262808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e0d1360b-2648-41d2-a49b-057a955bcbdf tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.152855 May 26 21:28:45.263368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 458/948] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:45 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:45.379706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:45.380241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:45.387758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.388212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.389024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:45.389463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:45.451140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:45.458703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-36914bad-e719-4eb5-b8da-1622604fabfb tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.082982 May 26 21:28:45.459274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 459/949] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:45 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:46.282433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:46.283455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:46.289902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.290355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.291148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.291589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.430760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:46.439699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:46.441566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:46.442755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8a6558b3-6bd4-44bc-aac2-2de4fb3dfac2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.164983 May 26 21:28:46.443325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 460/950] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:46 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:46.475669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:46.476290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:46.483629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.484086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.484976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:46.485560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:46.551600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:46.567559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-343f6273-c098-4c5d-bf46-2b597db4dbfc tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.095631 May 26 21:28:46.568412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 461/951] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:46 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:28:47.462239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:47.463012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:47.469890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.470334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.471143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.471589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.617370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.633735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.636645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.638824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b2fc0b59-fa0c-4f4f-8269-f5c707732675 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.180549 May 26 21:28:47.639853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 462/952] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:47 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:47.648524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:47.649922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:47.661141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.661941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.663338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:47.664132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:47.755000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:47.763321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bdaae7ee-76f2-4b5d-b43a-60a49147fb65 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.121811 May 26 21:28:47.763920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 463/953] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:47 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:48.658192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:48.658891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:48.665333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.665787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.666570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.667012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.817641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:48.827676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:48.829235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:48.830626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37ed4789-1532-4dfe-9d3a-ccc6215ab2d0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.176630 May 26 21:28:48.831141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 464/954] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:48 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:48.840803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:48.840803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:48.843230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.843684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.844476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:48.844943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:48.910578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:48.918337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4ebc2dc0-eeab-47e5-b52a-9fd97548294a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.086057 May 26 21:28:48.918922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 465/955] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:48 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:49.849412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:49.850169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:49.855179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:49.856788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:49.857251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:49.858041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:49.858484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:49.918246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=65 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:49.996895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.006118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.007656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.008899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84f6cfa5-0349-46e1-bec6-0b37ec030f18 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.163555 May 26 21:28:50.009472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 466/956] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:49 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:50.014539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:50.015157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:50.021375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.021833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.022624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:50.023071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:50.092428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:50.106512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1cae62f9-1eb2-4e4e-b8a7-0b80586f0e42 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.095496 May 26 21:28:50.107665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 467/957] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:50 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:51.032089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:51.033277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:51.043195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.043724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.044619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.045143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.190231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.206996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.214803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.214803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-af87818e-cef5-4b29-8fc2-09bcbc3abe83 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.188298 May 26 21:28:51.214803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 468/958] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:51 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:51.223078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:51.224320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:51.235843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.236701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.238130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:51.238917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:51.263956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:28:51.317053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:51.326185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b7a2a30b-af8a-4d18-be5b-5dc197f66a03 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.110492 May 26 21:28:51.326787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 469/959] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:51 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:52.233060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:52.233741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:52.240572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.241054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.241851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.242305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.385522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.394440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.396027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.397248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eeb9a0ea-f24e-41c8-9ba3-96aff7f44381 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.168891 May 26 21:28:52.397827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 470/960] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:52 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:52.403739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:52.404616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:52.410919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.411360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.412175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:52.412593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:52.474887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:52.484003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d2f296ea-1e6d-4a85-a19e-ece0b4259e55 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.084709 May 26 21:28:52.484497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 471/961] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:52 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:53.418234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:53.419035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:53.428550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.429121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.430006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.430242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.574090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:53.582872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:53.584399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:53.585598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5e3a9981-c9f0-4b2f-97c6-84981e62fd0c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.172670 May 26 21:28:53.586157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 472/962] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:53 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:53.590533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:53.591143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:53.596979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.597435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.598206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:53.598642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:53.664746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:53.673701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-30147429-b95d-4968-830d-61d93cfc461a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.086372 May 26 21:28:53.674193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 473/963] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:53 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:54.605258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:54.605967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:54.612768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:54.613221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:54.614013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:54.614455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:54.753321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.762491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.764022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.765286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71446eeb-2a54-4b1d-bf97-c66bf93a3a48 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.164512 May 26 21:28:54.765854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 474/964] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:54 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:54.770306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:54.770916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:54.776863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:54.777318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:54.778102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:54.778540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:54.846861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:54.855038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-22cfbb1b-4f79-4874-b275-698a1567461f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.088161 May 26 21:28:54.855639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 475/965] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:54 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:55.784094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:55.784877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:55.791740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.792951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.793740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.794179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.927761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:55.936165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:55.937690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:55.938909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5d753193-1bdf-4cb9-a86f-c38074c6a961 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.158769 May 26 21:28:55.939470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 476/966] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:55 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:55.943847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:55.944444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:55.950804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.951251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:55.952022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:55.952456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.021601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:56.030576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-630dab08-59f8-41a3-8b72-b2c712891821 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.090066 May 26 21:28:56.031307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 477/967] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:55 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:56.957925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:56.958621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:56.965194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.965657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:56.966429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:56.966870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.102652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.111653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.113216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.114409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-329087f1-7d95-4864-8d26-655d337cf59d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.160566 May 26 21:28:57.114980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 478/968] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:56 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:57.119762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:57.120967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:57.128186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.128505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.129333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:57.129776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:57.194839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:57.203503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d09a71f6-a98e-4b7c-9d22-3e517ab529d6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.087369 May 26 21:28:57.204096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 479/969] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:57 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:58.134022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:58.134726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:58.141872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.142328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.143113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.143553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.303789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.313346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.314883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.324721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1e22f0ac-0370-408a-94d2-41edd56ed8f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.186177 May 26 21:28:58.324721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 480/970] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:58 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:58.324721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:58.324721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:58.329511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.329962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.330746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:58.331240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:58.403930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:58.412558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-768ff98d-d440-4b70-a17f-c9c0f7ccea47 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.094769 May 26 21:28:58.413182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 481/971] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:58 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:28:59.339494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:59.340200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:59.347235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:59.347687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:59.348468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:59.348938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:59.496062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:59.506948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:59.508516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:59.509731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-821be386-fa23-4aa6-87a2-5b980bce17f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.174828 May 26 21:28:59.510304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 482/972] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:28:59 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:28:59.515620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:28:59.516227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:28:59.522752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:59.527198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:59.527198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:28:59.527198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:28:59.591158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:28:59.605438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2fb28597-e129-472f-b28a-e172b37e3d99 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.093448 May 26 21:28:59.606113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 483/973] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:28:59 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:00.530126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:00.531012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:00.537697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.538166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.538957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.539401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.685509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.694571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.696137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.697382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5d584c9-f5b3-42e3-99f0-9f872a9d2dc1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.172024 May 26 21:29:00.697959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 484/974] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:29:00 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:29:00.703375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:00.703999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:00.710779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.711242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.712174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:00.712647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:00.779926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:00.787623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0c522912-a8c6-4f00-9f17-6962dc6034c4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.088120 May 26 21:29:00.788208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 485/975] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:29:00 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:29:01.071581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:01.072764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.079717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.080167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.081006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.081453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.085640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:01.347501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1cf4b0bf-6343-42e7-89f9-33840c643075 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.279544 May 26 21:29:01.348615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 486/976] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:29:01 2022] POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:29:01.362870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:01.364178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.372795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.373457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.374590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.375132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.584300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:29:01.599799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1faf203f-a895-4e99-9534-7737a8341cb6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1750 microversion: 2.1 time: 0.244674 May 26 21:29:01.600802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 487/977] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:29:01 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1750 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:29:01.610227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:29:01.615120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.623282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.624096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.625799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.626575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.673522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-658cb509-aceb-4de3-94bb-1fbb7d690c40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/ips" status: 200 len: 149 microversion: 2.1 time: 0.070911 May 26 21:29:01.674464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 488/978] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:29:01 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/ips => generated 149 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:29:01.686428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d5d8e5a-7439-4cae-b177-439d61cc1b47"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:29:01.688027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:29:01.695778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.696343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:01.697292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:29:01.697824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:29:11.692485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=93 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:11.716744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:29:21.521914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:29:21.522532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:29:31.842454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:29:31.843212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:29:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:30:04.581802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:30:04.632503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: POST /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/os-volume_attachments HTTP/1.1 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 74 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:30:04.637363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {"volumeAttachment": {"volumeId": "2d5d8e5a-7439-4cae-b177-439d61cc1b47"}} May 26 21:30:04.641010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '1f68637f-abc4-4cda-8337-006a57db6ffe', 'body': {'volumeAttachment': {'volumeId': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'}}} May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:30:04.642879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:30:04.645720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:30:04.648401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:30:04.648401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:30:04.648401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:30:04.648401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc May 26 21:30:04.648401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:30:04.650862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: volume 2d5d8e5a-7439-4cae-b177-439d61cc1b47 is already attached to instances: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:30:04.652515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6931a3ce-1af7-41fa-ab47-7fc9353246cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 62.970767 May 26 21:30:04.653929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 489/979] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:29:01 2022] POST /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe/os-volume_attachments => generated 174 bytes in 62973 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:30:04.664115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:04.667017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:04.675368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.675974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.676787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.677246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.875150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:04.884614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:04.886214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:04.887544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a347fd13-1a6b-4580-ae7d-0721f7ee81f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.232236 May 26 21:30:04.888131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 490/980] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:30:04 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:04.893169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:04.893803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:04.900497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.900987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.901788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.902230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.974299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:04.982618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f2b0debc-44f3-498f-9cd1-ae56d45bb6a4 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.093254 May 26 21:30:04.983789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 491/981] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:04 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:04.988846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:04.989468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:04.996446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.996844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:04.997648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:04.998162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:05.185620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:05.195778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7934358e-8c48-4638-813f-73ce2fc67ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1758 microversion: 2.1 time: 0.210779 May 26 21:30:05.196368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 492/982] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:05.201458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:05.201967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:05.208781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:05.210391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:05.210391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:05.210681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:14.617160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:15.205809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=8 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:15.233703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=24 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:22.441974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:30:22.492141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:30:23.500562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 40860. May 26 21:30:23.504469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a998c189-8b07-44d4-b647-54aa757b891c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 202 len: 0 microversion: 2.1 time: 103.659302 May 26 21:30:23.505117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 491/983] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:28:39 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 0 bytes in 103661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:30:23.511238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:23.511832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:23.518708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.519167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.519944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.520404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.550552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:30:23.884405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-48cae083-cb06-4686-a80c-cbcdf624fc55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 204 len: 0 microversion: 2.1 time: 0.377734 May 26 21:30:23.884966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 492/984] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:30:23 2022] DELETE /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:30:23.890156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:23.890853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:23.897105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.897561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:23.898333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:23.898769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.039084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.048526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.050068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.051247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba857e80-e79c-4571-ab09-25ce26bd46f1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.165165 May 26 21:30:24.052204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 493/985] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:30:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:24.056789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:24.057400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:24.066726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.067192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.068163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.068736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.131029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.138548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-322d0bfe-c4af-4200-af3d-cb442688dce6 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.085313 May 26 21:30:24.139047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 494/986] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:24 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:24.144108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:24.144717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:24.150258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.150701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.151449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.151878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.292018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.299946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a7332726-1e45-4370-b065-4a021d5a6926 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1758 microversion: 2.1 time: 0.159881 May 26 21:30:24.300514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 495/987] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:24.304994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:24.305604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:24.311966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.312530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.313331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:24.313880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:24.466381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:24.474506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d630ecec-0db5-4cae-b8e9-d54dc4fa3ee4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1681 microversion: 2.1 time: 0.173002 May 26 21:30:24.475079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 496/988] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:24 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:25.070396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:25.071038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:25.077174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.077632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.078418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.078866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.215468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.224832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.226375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.227620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-32f98a3b-de89-42f6-aeea-f5b31ec4b490 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.161161 May 26 21:30:25.228185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 497/989] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:30:25 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:30:25.233062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:25.233791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:25.240508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.241005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.241775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.242211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.307516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:25.315349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d63d2849-9954-4a78-ae95-464d028aea3a tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.086178 May 26 21:30:25.315920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 498/990] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:25 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:25.452856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1807330355"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:25.453302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:25.459402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.459844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.460621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:25.461057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:25.589800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.network.security_group_api [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Removing security group 291efedd-4b06-4c77-bf9a-036031f95b2a from port 030ae099-94fa-4bf1-83eb-d3e51b6ea090 May 26 21:30:26.279320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d58483c-ca82-4a8f-b696-9d4b7137496a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action" status: 202 len: 0 microversion: 2.1 time: 0.830417 May 26 21:30:26.279999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 499/991] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:30:25 2022] POST /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 26 21:30:26.285512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:26.286267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:26.292934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.293388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.294176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.294618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.808201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:26.815480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-535db1ed-56a9-4f0e-9da5-f3140c781945 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1681 microversion: 2.1 time: 0.534370 May 26 21:30:26.816110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 500/992] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:26 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1681 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:26.820925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:26.821755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:26.828274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.828842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:26.829625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:26.830060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.128043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.137894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.140146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.142312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-52778f53-4c76-42db-b5a8-45698454eab5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.325259 May 26 21:30:27.143134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 501/993] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:30:26 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:27.148533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:27.149498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:27.159879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.160337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.161166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.161611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.287729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.299908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-042b9e9b-e75c-4b15-925e-cbd0767ff140 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.155463 May 26 21:30:27.300800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 502/994] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:27 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:27.306086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-0faa7fb3-489e-4fa8-afd2-d12c8898f4e8 req-83b994fa-5df6-4e2b-98fc-01499ab7da5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:30:27.315771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-0faa7fb3-489e-4fa8-afd2-d12c8898f4e8 req-83b994fa-5df6-4e2b-98fc-01499ab7da5b service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.316666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-0faa7fb3-489e-4fa8-afd2-d12c8898f4e8 req-83b994fa-5df6-4e2b-98fc-01499ab7da5b service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.328606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-0faa7fb3-489e-4fa8-afd2-d12c8898f4e8 req-83b994fa-5df6-4e2b-98fc-01499ab7da5b service nova] Creating event network-changed:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:30:27.334349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-0faa7fb3-489e-4fa8-afd2-d12c8898f4e8 req-83b994fa-5df6-4e2b-98fc-01499ab7da5b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032028 May 26 21:30:27.334954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 503/995] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:30:27.834872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:27.836037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:27.847333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.848189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.849361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.850090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.890989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:27.892017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:27.892483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'fault' on Instance uuid 1f68637f-abc4-4cda-8337-006a57db6ffe {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:30:27.944214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:27.956766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1403c388-28e7-443c-8c14-b71becbefc48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 200 len: 1332 microversion: 2.1 time: 0.127090 May 26 21:30:27.957367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 504/996] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:27 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:30:28.162121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:28.162750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:28.169840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.170303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.171439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.171898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.777589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:28.788670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:28.795546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:28.798076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-977f28fd-feb3-4568-9420-875dda80a2f8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1753 microversion: 2.20 time: 0.639521 May 26 21:30:28.799168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 505/997] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:30:28 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1753 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:30:28.807826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:28.808468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:28.815184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.815744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.816468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.816909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.891969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:30:28.901846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-49ce8ed2-2d04-496f-8a7b-ce53a77dc5b2 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.099816 May 26 21:30:28.903068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 506/998] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:30:28 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:30:28.910500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:30:28.911052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:30:28.921369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.921842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.922926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:30:28.923400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:30:28.931512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:32.448329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:38.916104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:30:39.040977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:31:18.799249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:31:18.799837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:31:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:31:32.744640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:31:32.745360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:31:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:32:04.987636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:32:04.990031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:32:04.991700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:04.992829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:04.994178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:04.995555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:04.996877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) May 26 21:32:04.998295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:04.999547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f9aa0dd1-98ce-4c61-8888-300a91ebbeee) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:32:04.999547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-acfb9e25-7b1b-41ee-b719-6b3dd79b181c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 119.794301 May 26 21:32:04.999547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 493/999] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:30:05 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 119796 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:32:05.144419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.145182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.153199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.153744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.154539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.154975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.169649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe HTTP/1.1 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:32:05.171262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:05.172929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '1f68637f-abc4-4cda-8337-006a57db6ffe'} May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:32:05.173922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:05.175332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:05.176705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:32:05.176705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8872d4b7-3a1b-4b1e-a5fd-3db031cf43d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 404 len: 111 microversion: 2.1 time: 0.178886 May 26 21:32:05.176705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 494/1000] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:32:04 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:32:05.242273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f68637f-abc4-4cda-8337-006a57db6ffe", "name": "network-vif-deleted", "tag": "8003cdb9-293b-47fe-b5a7-55765c01e2ce"}, {"name": "network-changed", "server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:32:05.252860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.256258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.267922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] Creating event network-vif-deleted:8003cdb9-293b-47fe-b5a7-55765c01e2ce for instance 1f68637f-abc4-4cda-8337-006a57db6ffe on hv-cinder-82880 May 26 21:32:05.268443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] Creating event network-changed:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:32:05.276673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-7119135e-3cfc-4a81-a3c0-4b46c437e818 req-f58e2a83-f37d-4132-9892-41657a512da1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101574 May 26 21:32:05.280090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 495/1001] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:32:05 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:32:05.314319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:32:05.451254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.451958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.459054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.462925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.462925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.462925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.623428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.633788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.639000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.639000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-118fcf7a-0683-4300-be66-93085b533b4d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.358160 May 26 21:32:05.639000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 496/1002] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:32:05 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:05.642516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.643272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.651983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.652652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.653717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.654282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.781951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b3a16d33-980e-4033-918a-a5df950001be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 202 len: 0 microversion: 2.1 time: 96.877302 May 26 21:32:05.784378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 507/1003] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:30:28 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 0 bytes in 96880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:32:05.791413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.792024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.798622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.799078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.799882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.800323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.846899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:05.854900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96354350-f68a-4656-a0aa-bbfeb80b3b3b tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.216797 May 26 21:32:05.855489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 497/1004] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:32:05 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:05.860123 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:05.860629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:05.867167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.867576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.870720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:05.870720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:05.899001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:32:05.967052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:32:05.996760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:32:05.999097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:32:06.000763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:06.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:06.003036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.004459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.006460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) May 26 21:32:06.007868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.010744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-de2efc06-8969-4f68-a2b5-cae6f6445df6) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:32:06.010744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-143cb665-30bc-498d-a020-a6c7932abba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 0.216486 May 26 21:32:06.010744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 508/1005] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:32:05 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 221 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:32:06.015328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.016074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.024647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.027509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.027509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.027509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.040922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe HTTP/1.1 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:32:06.042468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:06.044061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '1f68637f-abc4-4cda-8337-006a57db6ffe'} May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:32:06.045192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 21:32:06.046661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:32:06.051387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:32:06.051387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f842179f-4bda-45d0-bfbc-c2408db6c7a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 404 len: 111 microversion: 2.1 time: 0.039383 May 26 21:32:06.051387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 509/1006] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:32:06.054916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.055404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.055781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:32:06.057514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:32:06.058869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:06.059679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:32:06.061340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.062680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.064188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) May 26 21:32:06.065493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:32:06.066746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-cd497cb7-3699-4a9e-8319-df142f1e464d) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:32:06.066746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d6db2cb2-f89d-449e-a44b-b1454d083b83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 0.202588 May 26 21:32:06.066746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 498/1007] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:32:05 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 204 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:32:06.067270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.067731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.068742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.069026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.069420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.069546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.081030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.081634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.082413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.082848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.202907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.210619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fcddd7a3-8640-4f7d-820c-229e0c537477 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.150123 May 26 21:32:06.211299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 499/1008] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:32:06.216318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.216897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.222746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.223412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.224204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.224652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.335060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.343880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.345535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:32:06.346755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8d77d132-1939-445a-b321-70a8854e4fd1 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.297789 May 26 21:32:06.347328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 510/1009] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:32:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:32:06.352550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f4463df-9519-4d32-ad0b-823668fecf1b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '.version_select at 0x7f46c9feb310>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.431549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f4463df-9519-4d32-ad0b-823668fecf1b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340486138" status: 202 len: 0 microversion: 2.1 time: 0.083130 May 26 21:32:06.432163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 511/1010] 10.222.0.66 () {58 vars in 1220 bytes} [Thu May 26 21:32:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1340486138 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:32:06.440802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:32:06.440802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:32:06.445253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.445719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:06.446542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:32:06.446954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:32:16.220190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=14 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:16.243957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=34 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:16.442778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:16.468339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:22.597597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:32:22.705470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:32:32.602770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:32.718820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:32:41.533458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:32:41.534231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea (ip 10.222.0.66) !!! May 26 21:33:12.431192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:33:12.431782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:33:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:34:06.192509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:34:06.194708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:34:06.196366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:34:06.197706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:34:06.201184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.202578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:06.204138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) May 26 21:34:06.205554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:34:06.207657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d52ddfa3-eb14-4b40-bd36-ea32e02ab42b) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:06.207657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2fea3a1f-2131-4f60-99bf-f396b5b85470 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 119.983871 May 26 21:34:06.207657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 500/1011] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:32:06 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 119985 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:34:06.234726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:34:06.240269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:34:06.245311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:34:06.246655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:34:06.250012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.253821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:06.255945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) May 26 21:34:06.258367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:34:06.261315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1b20532d-180d-497b-8577-ec926d77c2ef) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:34:06.261315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b4ea6c13-f37b-4a72-bc10-0143c20cfa73 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 119.806381 May 26 21:34:06.261315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 512/1012] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:32:06 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 119807 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:34:06.261315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:06.261910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:06.261910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.261910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.261910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.262453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.322591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:06.323544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:06.330211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.330662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.331447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.331904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.412057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:06.420265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e25f62ac-b99d-436b-b693-5d0dcbda306f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.221942 May 26 21:34:06.421190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 501/1013] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:34:06 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:34:06.427165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:06.427702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:06.434327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.434779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.435526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:06.435761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.436200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.446942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:06.448485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:34:06.449729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b345b24b-f439-4bea-abaf-fdda1aecfeeb tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.208648 May 26 21:34:06.450281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 513/1014] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:34:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:34:06.457175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:34:06.458069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:34:06.464709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.465170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:06.465962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:34:06.466570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:34:16.434088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:16.460476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=10 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:16.461897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:16.486295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=10 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:22.826383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:22.869086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:34:31.852968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:34:31.853685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:34:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:34:32.831908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:32.873898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:34:38.808247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:34:38.808996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:34:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 (ip 10.222.0.66) !!! May 26 21:34:39.940592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:34:39.941180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:34:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:34:52.753070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:34:52.753778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:34:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 (ip 10.222.0.66) !!! May 26 21:36:01.543066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:36:01.543717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:36:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 (ip 10.222.0.66) !!! May 26 21:36:06.664047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:36:06.666282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:36:06.667907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:36:06.668806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:36:06.669955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:36:06.671115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:36:06.672128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) May 26 21:36:06.673366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:36:06.674453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a653011b-4ad9-466e-925c-8b0fd9676824) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:36:06.674453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d50a82a-3d62-4651-b38c-18e1f97cf6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 120.216127 May 26 21:36:06.674453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 514/1015] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:34:06 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 120217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:36:06.674453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:06.674755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:06.681031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.684478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.684478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.684478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.720874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a98df525-0351-4549-bfa4-ac40908f1445 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 202 len: 0 microversion: 2.1 time: 120.298090 May 26 21:36:06.721856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 502/1016] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:34:06 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 0 bytes in 120300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:36:06.727730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:06.728469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:06.734994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.740790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.740790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.740790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.805160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:06.813337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-69bc4b10-d201-451b-b24b-1c627066411f tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1226 microversion: 2.1 time: 0.090310 May 26 21:36:06.813855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 503/1017] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:36:06 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:36:06.818352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:06.821000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:06.825266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.825719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.826527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.826965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.958486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:06.967105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:06.968645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:36:06.969817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a10ab14b-abec-48ae-9788-24e1aeb2cc2d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.154910 May 26 21:36:06.970409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 504/1018] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:36:06 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:36:06.975147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:36:06.975642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:36:06.982171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.988293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:06.988293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:36:06.988293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:36:16.679053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:16.702334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:16.979800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=6 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:17.003195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:22.943291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:36:22.988319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:36:32.439523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:36:32.440222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:36:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 (ip 10.222.0.66) !!! May 26 21:36:32.947259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:36:32.992160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:37:51.861186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:37:51.861846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:37:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea (ip 10.222.0.66) !!! May 26 21:37:58.817125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:37:58.817686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 (ip 10.222.0.66) !!! May 26 21:37:59.949979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:37:59.950936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:37:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea (ip 10.222.0.66) !!! May 26 21:38:06.995508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:06.997791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:06.999333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:07.000558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:07.001759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.002885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:07.003973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) May 26 21:38:07.005136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-4695f6a1-1337-42b4-9b7e-32b3ab541eeb) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 120.330517 May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:38:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea (ip 10.222.0.66) !!! May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:38:07 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea (10.222.0.66) May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: CRITICAL nova [None req-d6775c91-797c-45fa-97ff-7fbb62559b82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Unhandled error: OSError: write error May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova OSError: write error May 26 21:38:07.006188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova May 26 21:38:07.006683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 515/1019] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:36:06 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 0 bytes in 120333 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) May 26 21:38:07.077850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:07.080146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:07.081522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:07.082156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:07.083174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.084379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:07.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) May 26 21:38:07.086522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:07.088264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:07.088368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c4bad453-a779-42c1-924e-f1fb20968262) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:07.088774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:07.091979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-47298f2d-22c5-4601-b778-1b8a88a39336 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 120.117116 May 26 21:38:07.092971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 505/1020] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:36:06 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 120122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:07.096402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.096964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.097903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.098347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.117562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:07.117562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:07.123623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.124430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:07.126130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:07.126736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:17.092246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:17.118568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:17.122571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:17.151030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:23.064764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.102779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.132104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:23.134265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:23.136105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.137180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.138487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.139864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.143386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) May 26 21:38:23.144726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.146425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95b1e4fb-91d2-4eb4-a46d-1ea1a4d6ba51) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:23.146425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dd9e7475-abe0-4a93-aee4-14b82919fb81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 16.133176 May 26 21:38:23.146425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 516/1021] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:07 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 16135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:23.180523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:23.183055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:23.184660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.185522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.186766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.188245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.190051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) May 26 21:38:23.191301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:23.192527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-22b03868-451f-43c3-a433-ecb8932f96d9) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:23.192527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de58911f-9bcb-4db4-81d1-6b69818cc464 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 16.090738 May 26 21:38:23.192527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 506/1022] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:07 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 16092 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:23.192527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.192942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.197906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.200122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.200122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.200122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.223169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.223671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.232684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.233132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.233257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.233644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.233894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.234133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lazy-loading 'fault' on Instance uuid 2c7120fd-a7b6-4fda-b546-794e1162ca96 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.234327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.277445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3efa221fe5843cbb3671f4a3512f83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e10dcba12ef48aa8be65c4628572c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:23.284905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8b12a74-4cb4-486c-a042-9f8f2165f340 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 200 len: 1231 microversion: 2.1 time: 0.098693 May 26 21:38:23.285488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 507/1023] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:23 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 1231 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:23.316368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 0e6ec354-4f9e-406a-80a5-90856a7fead8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.352050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.352712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.358864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.359322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.360099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.360545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.492836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:23.502107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:23.503724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:23.505019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b6442d82-41a8-40d1-bced-8aa1db19ec39 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.218277 May 26 21:38:23.505583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 508/1024] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:23 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:23.511147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c064a06c-7318-420d-b6ce-b78253ac526b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67" status: 202 len: 0 microversion: 2.1 time: 0.373142 May 26 21:38:23.511641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.511880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 517/1025] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:38:23.512227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.517376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.518169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.519929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.520478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.521364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.521870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.524537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.525037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.525816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.527469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.548854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:23.609641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.714790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:23.717173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:23.718686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.719408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.720661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.722011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.723259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) May 26 21:38:23.724622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.725855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9a353243-7a50-4688-8da9-fae449954cd8) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:23.725855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9e4a0136-93f0-47ae-8f2d-bbb57e3cf660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 0.205553 May 26 21:38:23.725855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 518/1026] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:23.725855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.726185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.731088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.736487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.736487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.736487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.816234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:23.864183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-158e752d-d77c-428d-bdeb-feaa2a5f2348 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 204 len: 0 microversion: 2.1 time: 0.357286 May 26 21:38:23.864931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 509/1027] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:23.870592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.871180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.871620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:23.873858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:23.879214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.879938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:23.881222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.882525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.883739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) May 26 21:38:23.885232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:23.887401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3128a9db-cd13-4f40-87cf-b40f8c3ea641) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:23.887401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5819c9a0-96a4-4a08-9c24-1fa6e67066b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 0.155133 May 26 21:38:23.887401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 519/1028] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 156 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:23.887867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.887867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.887867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.887867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.888400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:23.888400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:23.888400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.888400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.889353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:23.889695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:23.969931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.013219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 0e6ec354-4f9e-406a-80a5-90856a7fead8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.041649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:24.043904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:24.045542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.047950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.050104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.051352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) May 26 21:38:24.052694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.055045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9f13cce0-8355-4725-b5a0-5281b43f2ab2) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.055045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1d0c436d-1cba-46e1-9d99-dd8d01799898 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 0.179223 May 26 21:38:24.055045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 510/1029] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.055045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.055416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.057938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.058387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.059153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.059590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.073962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.077117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:24.077591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.079155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.080827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.082297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.083768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.083768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-51be0aaf-de47-4f77-ac97-8fd79db39800 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.031869 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Request method failure captured: May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 HTTP/1.1 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-_nTdn-VGltbDKCq8M4T3-1TIHO--GS8lpRY56ENIIHKrVmJnz1B-oIUrjDaBDniAjKBFcLSj59LgKxu32Q93FyW4rRU1nC7usMyy_vbSVNFiZpCbjFCM_GIFtdTYmZgohjYLFWIpGGVce5Uy3iCn2VNv2X9P6eebz5sxniGlv-DSg May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:24.083971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: f45b8987f3c24cf19de0fa81482c050a May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:24.085536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '0e6ec354-4f9e-406a-80a5-90856a7fead8', 'id': '2a936025-6d17-44ff-9e2c-30e1776fec67'} May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.086443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.087921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.089607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.091007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) May 26 21:38:24.092332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.093647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 511/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:24 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:38:24.093737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e5c573e3-255d-448f-820b-05aee10347f9) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.093737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-77c23eaa-b17f-4f84-b1af-8d80916c2a86 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67" status: 400 len: 269 microversion: 2.1 time: 0.204576 May 26 21:38:24.093737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 520/1031] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:23 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 => generated 269 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.093986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.093986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.094167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.094167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.094333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.094333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.094333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.094333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.095837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.096356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.097223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.097726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.124235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:24.170526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.compute.api [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Instance is already in deleting state, ignoring this request May 26 21:38:24.171348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-69d391cb-8c8f-4da0-b64f-3122bd65f9ac tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 204 len: 0 microversion: 2.1 time: 0.088202 May 26 21:38:24.171910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 521/1032] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:24.177592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.178092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.183805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.184258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.185056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.185502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.227496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.236702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.238245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.239600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ad36d502-c378-4a6f-b77d-08fc4626a8e0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.158491 May 26 21:38:24.240168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 512/1033] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:24.244691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.245188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.250925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.251946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.252750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.253192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.273538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.338404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.367637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:24.369845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:24.371117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.372168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.373293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.374469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.375455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) May 26 21:38:24.377195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.378248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-56682031-f86a-4f5c-aa96-23cec0b603e6) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.378248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-273029ed-f8d1-4555-a5e1-2d57729c9865 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 0.198427 May 26 21:38:24.378248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 522/1034] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.378248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.378543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.383761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.384213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.385024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.385467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.404045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:24.406229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:24.407875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.408530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.410676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.411711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) May 26 21:38:24.412815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.414176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-b5de3dbc-123a-4b3f-8a88-84682a318ba9) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.414176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8d7ec3a0-9829-4369-8e41-4a3b050081bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 0.166511 May 26 21:38:24.414176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 513/1035] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.414176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.414532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.419576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.420020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.420868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.421328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.465546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.511616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 0e6ec354-4f9e-406a-80a5-90856a7fead8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.537095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:24.539479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:24.541253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.542219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.543355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.544644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.545876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) May 26 21:38:24.547253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.549163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18e9293b-65bf-4650-afe2-095a4513a622) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.549163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2d932ada-cb68-44cd-bfaa-7e8df26e673f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 0.168706 May 26 21:38:24.549163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 523/1036] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 170 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.549163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.549528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.555648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.556106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.556914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.557353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.571672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:24.573413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.574779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.575495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:24.577256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.579690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.579690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbe711e5-4cd2-4e23-984d-cf0169fa3e9c tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.031937 May 26 21:38:24.579690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 524/1037] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:24 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:38:24.580441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.580931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.582684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Request method failure captured: May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 HTTP/1.1 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-_nTdn-VGltbDKCq8M4T3-1TIHO--GS8lpRY56ENIIHKrVmJnz1B-oIUrjDaBDniAjKBFcLSj59LgKxu32Q93FyW4rRU1nC7usMyy_vbSVNFiZpCbjFCM_GIFtdTYmZgohjYLFWIpGGVce5Uy3iCn2VNv2X9P6eebz5sxniGlv-DSg May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:24.584907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: f45b8987f3c24cf19de0fa81482c050a May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:24.586419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '0e6ec354-4f9e-406a-80a5-90856a7fead8', 'id': '2a936025-6d17-44ff-9e2c-30e1776fec67'} May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.587083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.588249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.589791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) May 26 21:38:24.592337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.593651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-566e10a4-aa22-413d-8350-7e9d81153752) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.593651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0614633-d75d-4c09-b851-415faf1140dc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67" status: 400 len: 269 microversion: 2.1 time: 0.177165 May 26 21:38:24.593651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 514/1038] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 => generated 269 bytes in 179 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.593872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.593872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.593872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.593872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.594171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.594171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.600491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.600966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.601733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.602173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.628254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:24.735576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.compute.api [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Instance is already in deleting state, ignoring this request May 26 21:38:24.737093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-02b88d8e-a791-4ae4-8791-bc91c3ee2402 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 204 len: 0 microversion: 2.1 time: 0.148214 May 26 21:38:24.737656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 515/1039] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:24.742392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.742882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.748903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.749349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.750110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.750543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.753590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.762607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.764284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:24.765577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-35768e66-3ba6-4643-b4c3-236c591d9ff5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.189091 May 26 21:38:24.766126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 525/1040] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:24 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:24.771112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.771754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.778673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.778673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.779079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.779507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.839202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.887939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:24.921657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:24.923887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:24.925388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.926227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.927326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.928693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.929713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) May 26 21:38:24.930807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:24.933271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fd763889-df33-41d4-96eb-2a8dde2f90ae) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.934494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eae2657b-834e-4cfd-b21a-8a8b7eb7668b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 0.195523 May 26 21:38:24.935230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 516/1041] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.940801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.941525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.949240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.949696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.950472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.950912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.959990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:24.962216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:24.963501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.964102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:24.965221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.966481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.967507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) May 26 21:38:24.968938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:24.973020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e09d86b2-2180-4a47-84c4-128168353bfa) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:24.973020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ddebb8c3-207c-4ec9-8640-5bac4146479a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 0.196640 May 26 21:38:24.973020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 526/1042] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 198 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:24.973020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:24.973630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:24.977201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.977685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:24.978435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:24.978871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.044019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.093393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 0e6ec354-4f9e-406a-80a5-90856a7fead8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.120808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:25.123259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:25.124615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.125522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.127344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.136149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.137478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) May 26 21:38:25.138739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.140002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e4404ee2-2c1e-45a3-9593-da9a8cb26457) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.140002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9ffe2463-964b-48e8-b926-490d2ad21a9a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 0.189257 May 26 21:38:25.140002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 517/1043] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.140002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.140353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.143198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.143726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.152195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.152752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.164829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Request method failure captured: May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 HTTP/1.1 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-_nTdn-VGltbDKCq8M4T3-1TIHO--GS8lpRY56ENIIHKrVmJnz1B-oIUrjDaBDniAjKBFcLSj59LgKxu32Q93FyW4rRU1nC7usMyy_vbSVNFiZpCbjFCM_GIFtdTYmZgohjYLFWIpGGVce5Uy3iCn2VNv2X9P6eebz5sxniGlv-DSg May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:25.167844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: f45b8987f3c24cf19de0fa81482c050a May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:25.178350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': '0e6ec354-4f9e-406a-80a5-90856a7fead8', 'id': '2a936025-6d17-44ff-9e2c-30e1776fec67'} May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.179185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.180229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.181427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.182499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) May 26 21:38:25.183830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.185183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.185273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8da18809-9ce0-4df1-bc9b-662770d0df3a) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.185273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db6c37bb-ec00-469a-937d-98bfd54d087a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67" status: 400 len: 269 microversion: 2.1 time: 0.204717 May 26 21:38:25.185273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 527/1044] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:24 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 => generated 269 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:25.185556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.187075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.187927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.189458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.192008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.192008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b81e1c62-96b8-43cf-b868-28077b34ae86 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.044346 May 26 21:38:25.192008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 518/1045] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:25 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:38:25.192008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.192008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.194143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.194143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.194317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.194416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.194517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.194623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.194772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.194917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.195057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.195200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.197831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:25.223424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:25.268721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.compute.api [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Instance is already in deleting state, ignoring this request May 26 21:38:25.269536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-36b45496-576c-4744-a6ee-ae1fd07710b6 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 204 len: 0 microversion: 2.1 time: 0.096130 May 26 21:38:25.270114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 519/1046] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:25.274716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.275192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.280972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.281418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.282175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.283204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.363664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.420498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:25.422674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:25.424192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.425014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.426431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.427594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.428615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) May 26 21:38:25.429659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.430694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2bf5bbd6-2dd8-4b2f-9e17-09400a4caa92) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.430694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-efb03ecf-92a5-44d6-a0e0-f9dc847d7f5e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 0.153088 May 26 21:38:25.430694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 520/1047] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.430694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.430991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.437497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.437933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.439651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.445227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.453914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.456187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.457482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6d8ba75d-f6a5-4fcf-b004-54d399ec255b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.285482 May 26 21:38:25.458119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 528/1048] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:25 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:25.462912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.463489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.470195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.470650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.471587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.472032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.476212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:25.526514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 3748fe34-6403-4819-a21a-19fd842440b9 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.573554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lazy-loading 'services' on Instance uuid c371c14f-9d30-4fb1-8986-4ca9550e4fc8 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.610841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 HTTP/1.1 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:25.613098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:38:25.614449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '3748fe34-6403-4819-a21a-19fd842440b9', 'id': '0105d0ec-9ef3-4075-9c45-15852cc7c852'} May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.615430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.616413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.625840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.627533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) May 26 21:38:25.628608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.630266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-017d7066-eaba-412a-9ab4-282d3d19a53a) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.630266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66a6f2b4-3972-4e6f-9ec6-bf9d0dfa6c93 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852" status: 400 len: 269 microversion: 2.1 time: 0.188470 May 26 21:38:25.630266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 521/1049] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments/0105d0ec-9ef3-4075-9c45-15852cc7c852 => generated 269 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.630266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.630760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.631268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.631719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.632488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.632961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.646997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Request method failure captured: May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea HTTP/1.1 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij_BaaB6F5jHk-5K8yzHxVoMdHWrz28sRF-u_zGEc2ai2ZH4s9uvQBk_j6FLzUmT82u4bIhF2YTjYTNW2KPtnX4oF-1FZQdQIUKKDA4MUSFTC08PAN6kVfEP-l49b3wPS55DaKUf9bWOI_Ka_9f_QC5hgofDf4-jeKQwdNA5Kwtn5nM4 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:25.649361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_198b0d7e8b204f858abb8474f90af623"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/198b0d7e8b204f858abb8474f90af623"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 198b0d7e8b204f858abb8474f90af623 May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestMinimumBasicScenario-316803243 May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: d3e7bb3f129f47c7869f3319f35ed15e May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestMinimumBasicScenario-316803243-project May 26 21:38:25.654052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'c371c14f-9d30-4fb1-8986-4ca9550e4fc8', 'id': 'f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea'} May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.656032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.659226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.663524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.666075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) May 26 21:38:25.669881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.672397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-9fef8f74-eafc-4c6d-8523-bc3422576d8b) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.672397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-517ebd31-128f-4702-812f-271f4138564a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea" status: 400 len: 269 microversion: 2.1 time: 0.191813 May 26 21:38:25.672397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 529/1050] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8/os-volume_attachments/f90b14d3-7c0b-4ac0-ab6b-ad11f97cbaea => generated 269 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.672397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.672734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.672734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.672734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.672734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.673028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.688058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:25.691439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.695768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.697540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:25.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:25.705152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.705152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c985cc8d-3aed-4fec-b830-ce18b1e026b9 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.038870 May 26 21:38:25.705152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 530/1051] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:25 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:38:25.707143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.707143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.713944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.716871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.716871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.716871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.854985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lazy-loading 'services' on Instance uuid 0e6ec354-4f9e-406a-80a5-90856a7fead8 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:25.926105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.933700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.935469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Request method failure captured: May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 HTTP/1.1 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-_nTdn-VGltbDKCq8M4T3-1TIHO--GS8lpRY56ENIIHKrVmJnz1B-oIUrjDaBDniAjKBFcLSj59LgKxu32Q93FyW4rRU1nC7usMyy_vbSVNFiZpCbjFCM_GIFtdTYmZgohjYLFWIpGGVce5Uy3iCn2VNv2X9P6eebz5sxniGlv-DSg May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:25.936049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/31ea80663206487ca3ea28c5bb4239f0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 31ea80663206487ca3ea28c5bb4239f0 May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1512769123 May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: f45b8987f3c24cf19de0fa81482c050a May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-VolumesSnapshotTestJSON-1512769123-project May 26 21:38:25.937402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'server_id': '0e6ec354-4f9e-406a-80a5-90856a7fead8', 'id': '2a936025-6d17-44ff-9e2c-30e1776fec67'} May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:25.939379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.940473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.941489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) May 26 21:38:25.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:25.943663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6f95e96f-fc73-4d69-b6cf-2fe30f62e018) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:25.943663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-32dd54fb-04f4-4e61-a62c-50e494db574d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67" status: 400 len: 269 microversion: 2.1 time: 0.321544 May 26 21:38:25.943663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 522/1052] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8/os-volume_attachments/2a936025-6d17-44ff-9e2c-30e1776fec67 => generated 269 bytes in 322 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:25.946253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:25.946440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.946910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.948017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cfdeacbe-12c1-4ff8-8b17-9fc556e2efed tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 200 len: 1747 microversion: 2.20 time: 0.246011 May 26 21:38:25.948811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 531/1053] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:25 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 1747 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:25.960827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:25.961406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:25.968038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.968798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.969482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.969961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.970869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.971270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:25.971711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:25.971864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.003313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:26.132725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid a593d7f5-c378-4a24-a59d-53fcf2e6ffcc {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:26.136283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.compute.api [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Instance is already in deleting state, ignoring this request May 26 21:38:26.137950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4431ef2c-3fd4-4a93-b61f-8636e69fd14f tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 204 len: 0 microversion: 2.1 time: 0.198120 May 26 21:38:26.137950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 523/1054] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:26.144124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:26.145188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:26.151604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.152092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.152906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.153912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.185808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0ec09663-fa14-461f-9bbc-984bf5c3f0dc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 May 26 21:38:26.186382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 524/1055] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:26.192508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1222054192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795338453", "security_groups": [{"name": "tempest-secgroup-smoke-623768988"}], "block_device_mapping_v2": [{"uuid": "a73821fc-2c5b-48e3-a676-5331bf77d690", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0535bc2-e682-4872-ab43-9cc512774e24"}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:26.211719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 HTTP/1.1 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:38:26.213898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:38:26.215168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc', 'id': '2d5d8e5a-7439-4cae-b177-439d61cc1b47'} May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:26.215835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:26.217493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:26.229436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:26.231136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) May 26 21:38:26.232495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:38:26.233916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1c811139-9b43-4004-b7d6-0edc5d1aa03a) {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:26.233916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf3e6021-4557-445e-8443-8d80e291a650 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47" status: 400 len: 269 microversion: 2.1 time: 0.265341 May 26 21:38:26.233916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 532/1056] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:38:25 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments/2d5d8e5a-7439-4cae-b177-439d61cc1b47 => generated 269 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:26.233916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:26.234268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:26.234268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.234811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.235751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.236281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.357502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] validate_networks() for [('c0535bc2-e682-4872-ab43-9cc512774e24', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:38:26.886762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e61a49c8-0c74-46e4-9631-add71deaec33 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments/7fd86ef3-bd9d-42ad-8bc0-2f4279cbaca7" status: 202 len: 0 microversion: 2.20 time: 0.669654 May 26 21:38:26.887621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 533/1057] 10.222.0.66 () {60 vars in 1456 bytes} [Thu May 26 21:38:26 2022] DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments/7fd86ef3-bd9d-42ad-8bc0-2f4279cbaca7 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 26 21:38:26.894205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:38:26.895228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:38:26.901187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:38:26.901187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:38:26.901187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:38:26.920015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.921393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.922893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.923793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.946543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:38:26.958556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-faa5046c-b603-4132-a2bb-98e1b71d40d5 req-970cbf44-c34f-41a1-9091-634dcfe0430c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7353f7c0-bddc-4c45-84b7-534af0b2fed7", "name": "network-vif-deleted", "tag": "b7bb9cad-415f-46ce-a0b3-0822cbd396cb"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:26.958846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Getting quotas for user b3efa221fe5843cbb3671f4a3512f83b and project 9e10dcba12ef48aa8be65c4628572c22. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:38:26.970079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-faa5046c-b603-4132-a2bb-98e1b71d40d5 req-970cbf44-c34f-41a1-9091-634dcfe0430c service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:26.979538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-faa5046c-b603-4132-a2bb-98e1b71d40d5 req-970cbf44-c34f-41a1-9091-634dcfe0430c service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:26.984307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-faa5046c-b603-4132-a2bb-98e1b71d40d5 req-970cbf44-c34f-41a1-9091-634dcfe0430c service nova] Creating event network-vif-deleted:b7bb9cad-415f-46ce-a0b3-0822cbd396cb for instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 on hv-cinder-82880 May 26 21:38:26.989773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-faa5046c-b603-4132-a2bb-98e1b71d40d5 req-970cbf44-c34f-41a1-9091-634dcfe0430c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100589 May 26 21:38:26.990604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 534/1058] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:27.003680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.004394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.013847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.013847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.013847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.014160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.037761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:38:27.040560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 9b24505d-e4cd-4a12-886d-540de31f59c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a73821fc-2c5b-48e3-a676-5331bf77d690',volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:38:27.055749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.056476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.057103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lazy-loading 'fault' on Instance uuid 7353f7c0-bddc-4c45-84b7-534af0b2fed7 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:38:27.120955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:27.129631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cfaabbbd-7b1b-47cb-b41d-5083f27ed717 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 200 len: 1424 microversion: 2.1 time: 0.131038 May 26 21:38:27.130417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 535/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:26 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:27.138074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.139051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.146161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.146609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.147394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.147831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.179443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-937ebf9d-f624-443a-9734-72f03d1a1008 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047983 May 26 21:38:27.180274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 536/1060] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:27.181756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.185364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: POST /compute/v2.1/servers HTTP/1.1 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 477 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:27.185680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.187316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {"server": {"name": "tempest-TestVolumeBootPattern-server-1222054192", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1795338453", "security_groups": [{"name": "tempest-secgroup-smoke-623768988"}], "block_device_mapping_v2": [{"uuid": "a73821fc-2c5b-48e3-a676-5331bf77d690", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c0535bc2-e682-4872-ab43-9cc512774e24"}]}} May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'body': {'server': {'name': 'tempest-TestVolumeBootPattern-server-1222054192', 'imageRef': '', 'flavorRef': '452', 'key_name': 'tempest-TestVolumeBootPattern-1795338453', 'security_groups': [{'name': 'tempest-secgroup-smoke-623768988'}], 'block_device_mapping_v2': [{'source_type': 'volume', 'destination_type': 'volume', 'boot_index': 0, 'delete_on_termination': False, 'volume_id': 'a73821fc-2c5b-48e3-a676-5331bf77d690'}], 'networks': [{'uuid': 'c0535bc2-e682-4872-ab43-9cc512774e24'}]}}} May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:27.188100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.force_reraise() May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise self.value May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:27.189580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1914, in _validate_bdm May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._check_attach_and_reserve_volume( May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4858, in _check_attach_and_reserve_volume May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi attachment_id = self.volume_api.attachment_create( May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 26 21:38:27.193747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 808, in attachment_create May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi LOG.error('Create attachment failed for volume ' May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.force_reraise() May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise self.value May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 800, in attachment_create May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi attachment_ref = cinderclient(context, '3.44').attachments.create( May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/api_versions.py", line 421, in substitution May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method.func(obj, *args, **kwargs) May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/attachments.py", line 39, in create May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi retval = self._create('/attachments', body, 'attachment') May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 306, in _create May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) May 26 21:38:27.195102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return self._create_instance( May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1536, in _provision_instances May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._cleanup_build_artifacts(None, instances_to_build) May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 21:38:27.196395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self.force_reraise() May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise self.value May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1446, in _provision_instances May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._bdm_validate_set_size_and_instance(context, May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1809, in _bdm_validate_set_size_and_instance May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._validate_bdm( May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1923, in _validate_bdm May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:27.197853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:27.199173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:27.200936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) May 26 21:38:27.200936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.201182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.201278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Volume a73821fc-2c5b-48e3-a676-5331bf77d690 status must be available or downloading to reserve, but the current status is in-use. (HTTP 400) (Request-ID: req-86264098-292c-4120-aa77-f037ed3c8cb6) {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:27.201278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-70ccdb98-aabb-4729-b846-82632057d2a5 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 400 len: 295 microversion: 2.1 time: 1.001198 May 26 21:38:27.201278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 525/1061] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:38:26 2022] POST /compute/v2.1/servers => generated 295 bytes in 1003 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:27.202655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.203112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.203900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.204476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.207715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.223549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.232449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.237455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.237455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.237455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.237757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-130042e0-5d0f-4cc6-8316-514a29095a24 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054152 May 26 21:38:27.242648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 537/1062] 10.222.0.66 () {60 vars in 1342 bytes} [Thu May 26 21:38:27 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:38:27.272732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e62c2813-1016-4631-8a97-8564236a000a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068767 May 26 21:38:27.273942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 526/1063] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:27.314384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.314879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.320998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.323039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.323039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.323039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.351915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:38:27.355176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.compute.api [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Working on deleting snapshot 076827d9-7848-4bcf-b822-8e56f4ef0f9c from shelved instance... May 26 21:38:27.775322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.775875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.782180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.783152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.783913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.784342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.798900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:27.800468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.802055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:27.802815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.804062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.805288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:27.805288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2e638d7c-e686-4278-89c6-097bca888582 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.030485 May 26 21:38:27.805288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 527/1064] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:38:27 2022] DELETE /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:38:27.810329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:27.811125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [instance: 2c7120fd-a7b6-4fda-b546-794e1162ca96] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:27.817611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.817853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.818682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:27.819174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:27.833047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] HTTP exception thrown: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Request method failure captured: May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 HTTP/1.1 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij--nl2brEDnC4UTklEa5UzMGb6Ja8dQ7YpItXCU3VxieX7Usw-V3A0ZWrFHAA4Yt0lrVkyv6GOVv7QG1wGRqzw5eMNEQiq4SqJSqBaJ9SPXKtRt6v5CMuyqhKgT7yavBVazeHWORqto_Ct-VsAikjotLgehvOJtMSZwfCNwzkZ0tDs8 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:27.834571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9e10dcba12ef48aa8be65c4628572c22"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9e10dcba12ef48aa8be65c4628572c22 May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestVolumeBootPattern-1655197124 May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: b3efa221fe5843cbb3671f4a3512f83b May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestVolumeBootPattern-1655197124-project May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.836193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '2c7120fd-a7b6-4fda-b546-794e1162ca96'} May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:27.837317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. May 26 21:38:27.839073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:27.841203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Returning 404 to user: Instance 2c7120fd-a7b6-4fda-b546-794e1162ca96 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:27.841203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-698a6575-6461-426b-ae0e-9e94a3e12645 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96" status: 404 len: 111 microversion: 2.1 time: 0.029334 May 26 21:38:27.841203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 528/1065] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:27 2022] GET /compute/v2.1/servers/2c7120fd-a7b6-4fda-b546-794e1162ca96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:38:28.147464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:28.148216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 7353f7c0-bddc-4c45-84b7-534af0b2fed7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:28.154435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.154924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.155766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.156334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.171846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] HTTP exception thrown: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Request method failure captured: May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 HTTP/1.1 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9Lywr7t29tQKjqxr7PwohxXejXbDaHBuXWMMi5P_489EhxMYG6tgDPLDaXH3vgSQAhjDcaor4wPUGJxF4vwV2X7tvN8sBzt9VzUPjyF3h23H2PG4Akxi1arIc5wSELD9NsUsSJpW4EVaCl8cZq85cAT-7wiY_413giSCo3sFb4XI0 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:28.172208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 23ed95370bfd46e3a1c6946701e66065 May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. May 26 21:38:28.174107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '7353f7c0-bddc-4c45-84b7-534af0b2fed7'} May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:28.175234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. May 26 21:38:28.176684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:28.178050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Returning 404 to user: Instance 7353f7c0-bddc-4c45-84b7-534af0b2fed7 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:28.178050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-acf29bf5-60d0-45e7-98af-0dee87fef814 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7" status: 404 len: 111 microversion: 2.1 time: 0.029943 May 26 21:38:28.178050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 529/1066] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:38:28 2022] GET /compute/v2.1/servers/7353f7c0-bddc-4c45-84b7-534af0b2fed7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:38:28.182865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4f9c9fc3-ffab-4048-9bae-d60b5105d4f1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '.version_select at 0x7f46c82ad0d0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:28.310721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4f9c9fc3-ffab-4048-9bae-d60b5105d4f1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-168069236" status: 202 len: 0 microversion: 2.1 time: 0.131446 May 26 21:38:28.311296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 530/1067] 10.222.0.66 () {58 vars in 1217 bytes} [Thu May 26 21:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-168069236 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:38:28.316762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:28.317689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:28.326564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.327092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.327788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.328226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.357606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e74110d7-2dd3-4ee9-929f-03686facfa21 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 May 26 21:38:28.358170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 531/1068] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:28.362962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:28.363875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:28.370386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.370704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.371350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.371928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.405574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b83b0d51-e010-4d45-8c1f-6cc6b987377f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046290 May 26 21:38:28.406176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 532/1069] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:28.780353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Doing local delete in cell 97faeabc-1cd1-4d3b-8b75-7848ba9e27ca(cell1) {{(pid=118354) _delete /opt/stack/nova/nova/compute/api.py:2489}} May 26 21:38:28.780353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:28.780353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:28.781151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.compute.api [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. May 26 21:38:28.787257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] deallocate_for_instance() {{(pid=118354) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1766}} May 26 21:38:29.368988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:29.369902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:29.376562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:29.377045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:29.377813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:29.378240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:29.408929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3bb8ec98-f19e-4232-a338-0a0ba43a88b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 May 26 21:38:29.409560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 533/1070] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:29.417879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:29.418794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:29.425088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:29.425534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:29.426721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:29.427002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:29.458342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-53c62d33-d303-4a92-a55e-ffe256308b18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 May 26 21:38:29.458856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 534/1071] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:29.760707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-051dfbc3-5f84-4360-aaa0-f0c1cc573fad req-2f23ecf3-f74b-4757-9686-5d869209e5a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e09a92-16a3-42f4-8961-6cb2a1decba3", "name": "network-vif-deleted", "tag": "f05cef3c-e3f9-4f57-80cb-753ef76b7536"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:29.770440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-051dfbc3-5f84-4360-aaa0-f0c1cc573fad req-2f23ecf3-f74b-4757-9686-5d869209e5a0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:29.773935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-051dfbc3-5f84-4360-aaa0-f0c1cc573fad req-2f23ecf3-f74b-4757-9686-5d869209e5a0 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:29.782461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.compute.server_external_events [req-051dfbc3-5f84-4360-aaa0-f0c1cc573fad req-2f23ecf3-f74b-4757-9686-5d869209e5a0 service nova] Unable to find a host for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3. Dropping event network-vif-deleted {{(pid=118355) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 21:38:29.784086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-051dfbc3-5f84-4360-aaa0-f0c1cc573fad req-2f23ecf3-f74b-4757-9686-5d869209e5a0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029953 May 26 21:38:29.784814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 535/1072] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 26 21:38:29.829943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Updating instance_info_cache with network_info: [] {{(pid=118354) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} May 26 21:38:30.406627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.scheduler.client.report [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Deleted allocations for instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 May 26 21:38:30.421820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:30.425327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:30.433133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.433780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.434897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.435470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.453525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:30.466699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a4d12b96-32c0-4f3d-87f5-a050629a2114 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049873 May 26 21:38:30.467277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 536/1073] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:30.477114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:30.477114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:30.478784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.479236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.480009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.480445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.514377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a87736b2-a98d-4c47-b9f5-2dbb391bbc3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046006 May 26 21:38:30.515064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 537/1074] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:30.632061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=13,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:30.771595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ca0d712a-a975-44eb-976a-a9ce9b249f7f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 204 len: 0 microversion: 2.20 time: 3.461656 May 26 21:38:30.772189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 538/1075] 10.222.0.66 () {60 vars in 1279 bytes} [Thu May 26 21:38:27 2022] DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 0 bytes in 3463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 21:38:30.780951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:30.781570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:30.789337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.789791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.790578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:30.791092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:30.805928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 HTTP/1.1 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:38:30.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:38:30.809182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '40e09a92-16a3-42f4-8961-6cb2a1decba3'} May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:38:30.809987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:38:30.811221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:38:30.812329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:38:30.812329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d07fb4c2-b2f8-4d8c-a253-95e27287ac41 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 404 len: 111 microversion: 2.20 time: 0.032472 May 26 21:38:30.812329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 538/1076] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:30 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:38:30.819467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-15efc427-a0fc-4800-aae7-16ef7218d008 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '.version_select at 0x7f46cd2448b0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:30.901678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-15efc427-a0fc-4800-aae7-16ef7218d008 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903541608" status: 204 len: 0 microversion: 2.20 time: 0.086205 May 26 21:38:30.902753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 539/1077] 10.222.0.66 () {60 vars in 1261 bytes} [Thu May 26 21:38:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1903541608 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 21:38:31.478958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:31.479901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:31.487681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.488169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.488941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.489380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.521039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-80ceeb15-adcb-4ebc-9e72-0f0cc2a7a2ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046598 May 26 21:38:31.521497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 539/1078] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:31.527741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:31.528940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:31.538003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.538560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.539436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:31.539873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:31.571042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0f3b80cd-72f8-4ca5-8534-ba5cd93b45ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047670 May 26 21:38:31.573380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 540/1079] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:31.730106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-745de258-20a3-4fd1-acc2-28432e2d6404 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'create', calling method: .version_select at 0x7f46c82ad160>, body: {"keypair": {"name": "tempest-keypair-1298626192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCxXhqm3o3cbOXdLrJ7PIzYKKwcb60YFsZKGW6sq4r81Q2j5kbv9OfnmK85kIV3ALYk9aH303eH85TiHNgoetkLZmpwyxqVAGtLo/m4jIBK1YHafY0/xUl+pbk9tqSbm/A=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:31.754546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-745de258-20a3-4fd1-acc2-28432e2d6404 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:38:31.761904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-745de258-20a3-4fd1-acc2-28432e2d6404 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for user 7d524a8208354c2099eb3b41b0f53de2 and project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:38:31.790758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:31.905453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-745de258-20a3-4fd1-acc2-28432e2d6404 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.179883 May 26 21:38:31.906094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 540/1080] 10.222.0.66 () {62 vars in 1199 bytes} [Thu May 26 21:38:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 181 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 26 21:38:32.541286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:32.541803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:32.549956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.550403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.551169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.551599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.585824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:32.591012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:32.593811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a7c2f71a-2fbc-4447-b99e-a4c0f4e6d349 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059879 May 26 21:38:32.594609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 541/1081] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:32.595093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.595556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.596353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:32.596833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:32.630570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e5ae0cfd-3664-468c-b3c7-a5766c479b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049131 May 26 21:38:32.637855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 541/1082] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:33.605740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:33.606652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:33.613571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.616624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.616624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.616624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.648119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea4f5356-f7a7-446b-bc00-94f7c1f7e801 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046557 May 26 21:38:33.648614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:33.649130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 542/1083] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:33.650159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:33.657620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.658213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.659051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:33.659812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:33.699526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-912eab60-5846-4ea3-8229-832df6a1c56b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054983 May 26 21:38:33.700414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 542/1084] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:34.272879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-447624365", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a507481f-71f1-4c10-ab11-2f99d3b1809b"}], "security_groups": [{"name": "tempest-securitygroup--1902227072"}], "key_name": "tempest-keypair-1298626192", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:34.374681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] validate_networks() for [('a507481f-71f1-4c10-ab11-2f99d3b1809b', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:38:34.661303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:34.662273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:34.669708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.670140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.670938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.671380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.702332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-da67aab4-7345-4bf4-b368-fde3f0947c90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045464 May 26 21:38:34.702928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 543/1085] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:34.711393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:34.712332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:34.718500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.718958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.720317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:34.720803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:34.751734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6b9f918e-7e98-4516-9bd0-6091a4cb8954 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 May 26 21:38:34.752314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 544/1086] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:35.076670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:38:35.077148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:38:35.077560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:38:35.077972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:38:35.078545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:38:35.088060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.088494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.089334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.089783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.107489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:38:35.111602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Getting quotas for user 7d524a8208354c2099eb3b41b0f53de2 and project 28874954ef9f45c78ad761ed4a1719cb. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:38:35.122735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:38:35.125146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:38:35.301453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8f93a14b-6b18-456a-a246-4f26ffe27a9b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.032349 May 26 21:38:35.302299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 543/1087] 10.222.0.66 () {62 vars in 1187 bytes} [Thu May 26 21:38:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 26 21:38:35.319241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:35.320996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:35.410401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:35.415798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:35.417698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:35.418909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-44e7bc90-a6f3-4025-a2c6-01d01aa858b9 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1281 microversion: 2.20 time: 0.108744 May 26 21:38:35.419545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 545/1088] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:35 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1281 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:35.715251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:35.716219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:35.729935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.730393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.731178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.731764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.763559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:35.765161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:35.766001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ed2c430d-770d-43bf-8a7c-a32d16af38fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055194 May 26 21:38:35.766769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 544/1089] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:35.774711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.775166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.775941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:35.776378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:35.808317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-38962e92-9c01-4e70-8490-c7f71423dac5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 May 26 21:38:35.808939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 546/1090] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:36.437794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:36.438550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:36.445181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.445625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.446430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.446895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.514705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:36.523910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:36.525566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:36.526672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ee4fb94-1f82-479f-a06b-a7b2afbef1dc tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1285 microversion: 2.20 time: 0.092980 May 26 21:38:36.527229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 545/1091] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:36 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:36.778014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:36.779124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:36.785925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.786368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.787128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.787556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.816971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98b3234e-de65-4b98-8c62-4a1687758f36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042956 May 26 21:38:36.817801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 547/1092] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:36.820041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:36.821089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:36.828684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.829225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.830626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:36.831113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:36.860743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d1a7cd9c-c649-4ca5-9a00-1216b002602b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 May 26 21:38:36.861343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 546/1093] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:37.545004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:37.545648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:37.547487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:37.553039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.553428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.558624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.558624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.659801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:37.668129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:37.669711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:37.670857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8a08cbc9-b804-4c4a-b7f1-10c4e520a514 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1339 microversion: 2.20 time: 0.130119 May 26 21:38:37.681989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 548/1094] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:37 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1339 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:37.827849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:37.828799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:37.836315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.836792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.837564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.847145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.869629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95de6777-0003-448f-9715-cac3df474422 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045648 May 26 21:38:37.870506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 547/1095] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:37.873034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:37.874577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:37.881282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.881739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.882522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:37.883174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:37.914477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-da09d831-89e6-41ed-bdc8-bd14d65dd337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046123 May 26 21:38:37.915037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 549/1096] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:38.690489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:38.691020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:38.697162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.697616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.698390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.698830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.882043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:38.882996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:38.894928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.895719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.896853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.897548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.938650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-91dc8529-e37f-445f-b026-8ea61ed50316 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059945 May 26 21:38:38.939504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 550/1097] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:38.951940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:38.952866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:38.960648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.960864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.961572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:38.962023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:38.970085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:38.978844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:38.980375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:38.982677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-070fd509-06d3-4f8d-aee7-4aa8ac009e42 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.296929 May 26 21:38:38.983740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 548/1098] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:38 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:38.998173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ce151eac-ebf9-4d89-a9a4-2679b8d0f39b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050530 May 26 21:38:38.998988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 551/1099] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:39.213121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-009c6219-7d06-4e2a-b83b-56a88b559e18 req-6cd65224-9dd2-4fcf-8a29-4a9e0a3f0af1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3c1b5f-d433-4d79-b190-8ff620c536b7", "tag": "d152b7d8-b896-480f-9145-51feda66a518"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:39.221224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-009c6219-7d06-4e2a-b83b-56a88b559e18 req-6cd65224-9dd2-4fcf-8a29-4a9e0a3f0af1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:39.222089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-009c6219-7d06-4e2a-b83b-56a88b559e18 req-6cd65224-9dd2-4fcf-8a29-4a9e0a3f0af1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:39.233893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-009c6219-7d06-4e2a-b83b-56a88b559e18 req-6cd65224-9dd2-4fcf-8a29-4a9e0a3f0af1 service nova] Creating event network-changed:d152b7d8-b896-480f-9145-51feda66a518 for instance de3c1b5f-d433-4d79-b190-8ff620c536b7 on hv-cinder-82880 May 26 21:38:39.240236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-009c6219-7d06-4e2a-b83b-56a88b559e18 req-6cd65224-9dd2-4fcf-8a29-4a9e0a3f0af1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030977 May 26 21:38:39.241015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 549/1100] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:39.953182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:39.955703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:39.965785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:39.966377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:39.967517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:39.968442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:40.006716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:40.008739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:40.008871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c6025e5e-bb01-44a1-9310-73f4f27f7512 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060972 May 26 21:38:40.009215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 552/1101] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:40.014068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:40.014948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:40.015092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:40.015404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:40.016180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:40.016645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:40.022833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:40.023295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:40.024361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:40.024868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:40.058463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c342dbb8-b317-473c-9b02-17e770dcda13 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 May 26 21:38:40.059045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 553/1102] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:40.161961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:40.170558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:40.172084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:40.173342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-33ff2157-a0fc-4d4c-92e2-8fd90500493f tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.171817 May 26 21:38:40.173936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 550/1103] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:40 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:38:41.022734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:41.024171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:41.033404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.033864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.035118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.035615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.073340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b6c6b88-9411-4c01-be42-5f772feabd00 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057207 May 26 21:38:41.074272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:41.075846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:41.077170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 554/1104] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:41.084028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.084485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.085301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.085740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.114625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-974476d3-9a13-45d3-9103-db84fc47b763 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 May 26 21:38:41.115201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 551/1105] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:41.192977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:41.193382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:41.200811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.200811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.201332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:41.201778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:41.338278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:41.341776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:41.346698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:41.348254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:41.349415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9565c40f-8d48-48c5-af03-6373583fc3af tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.161313 May 26 21:38:41.350050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 555/1106] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:41 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:42.085222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:42.086150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:42.089616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:42.093266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.096175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.096175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.096175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.128379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a4c35304-6f8f-4cf8-ae14-b37fbf650f0c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047246 May 26 21:38:42.128999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 552/1107] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:42.129233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:42.130261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:42.137571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.138016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.138785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.139217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.170714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-24f353c1-72d2-415b-9a2f-1b8bfd689908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047910 May 26 21:38:42.171281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 556/1108] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:42.369271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:42.369883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:42.376412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.376914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.377678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:42.378113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:42.513381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:42.522566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:42.525119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:42.525296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ff1704bf-2b1f-44da-94b0-384400e38ba3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.161249 May 26 21:38:42.525787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 553/1109] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:42 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 26 21:38:43.143035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:43.143812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:43.151726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.151981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.152932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.153287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.183400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:43.184452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:43.186869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e53d865f-0c41-4624-850c-3402c550e483 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050725 May 26 21:38:43.187546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 557/1110] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:43.192517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.193002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.193972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.194283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.226947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7c214129-44c1-4390-8e14-56cdd4072b8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047825 May 26 21:38:43.227548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 554/1111] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:43.542887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:43.543425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:43.550461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.550922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.551708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:43.552148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:43.693771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:43.701982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:43.703505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:43.704655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66a1ddac-f429-4940-9ead-897a0adf26a7 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.165865 May 26 21:38:43.705211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 558/1112] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:43 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:44.199318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:44.200262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:44.207015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.207494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.208255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.208729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.240735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:44.241746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:44.242892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b596bed-4906-4cd5-8c24-ffe64c4a7012 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047442 May 26 21:38:44.247516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 555/1113] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:44.249007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.249462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.250288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.250730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.282331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-415ec4fb-6361-45a4-aca3-0e78989fa135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047631 May 26 21:38:44.282919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 559/1114] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:44.723020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:44.723635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:44.729882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.730332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.731101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:44.731542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:44.747190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:DELETE=2,nova_cell1:SELECT=91 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:44.872467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:44.880949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:44.882449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:44.883549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24d6f019-2aaf-436e-a286-a91ff7c2fc6d tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.165058 May 26 21:38:44.884145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 556/1115] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:44 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:45.258915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:45.259936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:45.268037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.268776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.269643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.270158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.295757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:45.296817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:45.300264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:45.301107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=6 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:45.303965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5310fcd5-049f-40d4-bd3c-605f39fda2f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049720 May 26 21:38:45.305352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.305804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.306582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.307012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.307903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 560/1116] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:45.343992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-85d0bcc4-7a30-4c73-bf96-1e4798e350ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052536 May 26 21:38:45.344609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 557/1117] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:45.385683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-2eb00c5c-294f-4bbe-ba02-d3f9bca04239 req-d931c269-42a7-4367-aa32-bc5cf868796f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3c1b5f-d433-4d79-b190-8ff620c536b7", "name": "network-vif-plugged", "status": "completed", "tag": "d152b7d8-b896-480f-9145-51feda66a518"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:45.394774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2eb00c5c-294f-4bbe-ba02-d3f9bca04239 req-d931c269-42a7-4367-aa32-bc5cf868796f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.395203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2eb00c5c-294f-4bbe-ba02-d3f9bca04239 req-d931c269-42a7-4367-aa32-bc5cf868796f service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.408511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-2eb00c5c-294f-4bbe-ba02-d3f9bca04239 req-d931c269-42a7-4367-aa32-bc5cf868796f service nova] Creating event network-vif-plugged:d152b7d8-b896-480f-9145-51feda66a518 for instance de3c1b5f-d433-4d79-b190-8ff620c536b7 on hv-cinder-82880 May 26 21:38:45.415327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-2eb00c5c-294f-4bbe-ba02-d3f9bca04239 req-d931c269-42a7-4367-aa32-bc5cf868796f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098095 May 26 21:38:45.418812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 561/1118] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:45.903286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:45.903469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:45.910399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.910867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:45.911665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:45.912116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:46.067024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:46.076952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:46.078505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:46.079702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a8be9e4e-39ee-4e00-add5-c00c400224a0 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.181793 May 26 21:38:46.080323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 558/1119] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:45 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:46.315777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:46.316839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:46.318856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=12 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:46.324827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:46.325279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:46.326059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:46.326501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:46.355531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:46.356463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:46.358960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-38dfbc10-0584-4a27-af4f-b8cbedd8fce8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 May 26 21:38:46.359541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 562/1120] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:46.363904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:46.364360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:46.367764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:46.367764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:46.394741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e589286d-7a0d-46e9-acb9-048bdfbe9fd2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043204 May 26 21:38:46.395303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 559/1121] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:47.098121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:47.098752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:47.104771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.105219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.105976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.106501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.255732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:47.263964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:47.265499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:47.266611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b252f1bf-4882-414f-9fc8-7a182127ad17 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1407 microversion: 2.20 time: 0.172782 May 26 21:38:47.267168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 563/1122] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:47 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:47.381765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:47.382727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:47.389501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.389972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.390813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.391254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.409839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:47.411546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:47.422029 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.422750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.424514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:47.425244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:47.437335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-88cf2c28-779c-4136-a806-d0466a5b0610 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059925 May 26 21:38:47.438301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 560/1123] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:47.464210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c3ae7189-9859-49bd-a8f6-47b9a6a580cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061395 May 26 21:38:47.464818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 564/1124] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:48.286177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:48.286700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:48.292670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.293126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.293885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.294321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.427190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:48.435298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:48.436870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:38:48.438026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3fcbd84c-9cab-4c4d-a499-f474ea7b99ae tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1599 microversion: 2.20 time: 0.156506 May 26 21:38:48.438575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 561/1125] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:38:48 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:38:48.451248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:48.452241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:48.455322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:48.455827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:48.459623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.460060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.460879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.461312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.461841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.462295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.463060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.463502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.492144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cdeaf2e2-a31a-4bfb-bf36-86788f52c5a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 May 26 21:38:48.493048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 565/1126] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:48.498021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:48.498919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:48.505568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.506008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.506772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:48.507198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:48.536728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a27985bd-4550-4552-943c-5b68267e56db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 May 26 21:38:48.537203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 566/1127] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:48.541768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-50f35cb3-0f8f-4ff3-a5b8-8817c756f95b tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090644 May 26 21:38:48.542356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 562/1128] 10.222.0.66 () {60 vars in 1315 bytes} [Thu May 26 21:38:48 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:38:49.503971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:49.504939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:49.511402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:49.511854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:49.512848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:49.513447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:49.546542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-da8d4016-d797-41ed-80c2-907c53b65d6a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046658 May 26 21:38:49.547913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:49.549594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:49.563533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 567/1129] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:49.563533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-bc9c80ca-783d-4478-abe4-e94dd9e00cce req-030b3e12-dfd5-4df1-9efd-bcff05430a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de3c1b5f-d433-4d79-b190-8ff620c536b7", "tag": "d152b7d8-b896-480f-9145-51feda66a518"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:38:49.564379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-bc9c80ca-783d-4478-abe4-e94dd9e00cce req-030b3e12-dfd5-4df1-9efd-bcff05430a58 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:49.564379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-bc9c80ca-783d-4478-abe4-e94dd9e00cce req-030b3e12-dfd5-4df1-9efd-bcff05430a58 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:49.565351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:49.565808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:49.566578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:49.567012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:49.575512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-bc9c80ca-783d-4478-abe4-e94dd9e00cce req-030b3e12-dfd5-4df1-9efd-bcff05430a58 service nova] Creating event network-changed:d152b7d8-b896-480f-9145-51feda66a518 for instance de3c1b5f-d433-4d79-b190-8ff620c536b7 on hv-cinder-82880 May 26 21:38:49.580631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-bc9c80ca-783d-4478-abe4-e94dd9e00cce req-030b3e12-dfd5-4df1-9efd-bcff05430a58 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028322 May 26 21:38:49.581587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 568/1130] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:49.604237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ec8ad76-09da-450b-ac64-005407c514b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060708 May 26 21:38:49.605127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 563/1131] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:38:50.563769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:50.563769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:50.568079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:50.568546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:50.569506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:50.569944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:50.599298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1ba491d-a9ad-4a9c-a028-a4b5336752bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 May 26 21:38:50.599860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 569/1132] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:50.615891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:50.616907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:50.623409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:50.623865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:50.624683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:50.625149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:50.656734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44f2e0fb-5851-43e6-a47f-351f50f98846 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044724 May 26 21:38:50.657317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 564/1133] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:51.610914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:51.612006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:51.618736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:51.619194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:51.619961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:51.620402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:51.651184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d67d65c-c88d-4808-bbd4-c2e88f95d0ff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 May 26 21:38:51.651783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 570/1134] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:51.667274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:51.668293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:51.675357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:51.675808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:51.676598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:51.677054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:51.707542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ebc9d26-e943-4e31-b958-79bdc6da5f31 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 May 26 21:38:51.708107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 565/1135] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:52.662863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:52.663809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:52.670477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:52.670921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:52.671685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:52.672113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:52.702586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-371dd045-bcdb-4f1c-a18c-4ecf254d9769 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043644 May 26 21:38:52.703144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 571/1136] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:52.718536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:52.719463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:52.726014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:52.726458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:52.727220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:52.727709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:52.757349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-82b33638-0e59-411c-a500-2f1a5409387b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042632 May 26 21:38:52.757828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 566/1137] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:53.714066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:53.714991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:53.721564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:53.722020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:53.722789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:53.723230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:53.752877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fe3e8dd0-0e19-429b-b75c-03ee40aae7fc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042706 May 26 21:38:53.753432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 572/1138] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:53.768345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:53.769308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:53.775723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:53.776176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:53.776977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:53.777400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:53.807655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bcc31ebe-773c-4936-8eaf-382f0a657228 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 May 26 21:38:53.808211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 567/1139] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:54.763555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:54.764472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:54.771767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:54.772206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:54.772992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:54.773429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:54.797589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:38:54.801970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a073d50-6a77-4461-8fc5-649807aaaee1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042361 May 26 21:38:54.812001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 573/1140] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:54.819719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:54.820677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:54.827158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:54.827605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:54.828367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:54.828851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:54.857821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8bed4f67-c784-48d7-9e6c-d3e1d2e52361 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041996 May 26 21:38:54.858413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 568/1141] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:55.820291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:55.821315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:55.827928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:55.828399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:55.829257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:55.829630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:55.857917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4e0e6aa6-fe35-4484-a9af-5d77f76af39f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041904 May 26 21:38:55.858512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 574/1142] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:55.869869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:55.870799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:55.877897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:55.878349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:55.879115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:55.879554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:55.908178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c837afe-7bb7-4792-b145-aacfbfe5eeca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042177 May 26 21:38:55.908772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 569/1143] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:56.870559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:56.871484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:56.878004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:56.878453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:56.879215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:56.879653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:56.908758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f1505566-a78f-49a7-ad29-9e1c7358d169 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042039 May 26 21:38:56.909330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 575/1144] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:56.919298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:56.920210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:56.927437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:56.927881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:56.928665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:56.929099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:56.956609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-472655d6-d492-4f78-a870-de1fb2471e3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041244 May 26 21:38:56.957148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 570/1145] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:57.920709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:57.921626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:57.928688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:57.929129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:57.929888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:57.930323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:57.959096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61b3722e-7071-467c-93b2-b9eae19ca49a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042425 May 26 21:38:57.959647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 576/1146] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:57.967250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:57.968208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:57.974425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:57.974955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:57.975721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:57.976187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:58.006074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8b3c524f-ce29-4e02-a9a5-539ef738ab1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 May 26 21:38:58.006648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 571/1147] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:58.970260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:58.971868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:58.978474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:58.978930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:58.979701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:58.980145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:59.009949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-27344313-c64f-408b-b55e-aad8416f0aa8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 May 26 21:38:59.010512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 577/1148] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:38:59.017757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:38:59.018769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:38:59.025231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:59.025682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:59.026447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:38:59.026886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:38:59.054877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-322f846d-ff00-46b5-9fd5-dad5f672641c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041903 May 26 21:38:59.055429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 572/1149] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:38:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:00.022398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:00.023491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:00.030093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:00.030552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:00.031329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:00.031770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:00.060745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-78b84a9d-08f5-4363-92e8-0e70561ea452 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042293 May 26 21:39:00.061318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 578/1150] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:00.066358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:00.073297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:00.073705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:00.074152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:00.074906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:00.075339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:00.089531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:00.106936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-10153c97-ba3a-42f5-9abe-ac5dc1239a95 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044947 May 26 21:39:00.107502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 573/1151] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:01.072777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:01.073732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:01.080817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:01.081271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:01.082046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:01.082482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:01.112200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8e28ffaf-4312-453a-ad2d-5f39d5aa0306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 May 26 21:39:01.113586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 579/1152] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:01.121632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:01.122561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:01.129621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:01.133100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:01.133100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:01.133100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:01.161601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a5059e2d-ea41-46bb-8aae-e876447918a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 May 26 21:39:01.162173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 574/1153] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:02.125236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:02.126150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:02.132601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:02.133061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:02.133814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:02.134246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:02.163543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-09d4ec37-fd92-485f-a081-3bed679710cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042133 May 26 21:39:02.164092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 580/1154] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:02.173931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:02.174852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:02.181261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:02.181714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:02.182517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:02.182959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:02.211220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7bfd59fe-e920-4cbb-991d-e18e6d9cd986 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041820 May 26 21:39:02.211777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 575/1155] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:03.175604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:03.176520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:03.183193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:03.183641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:03.184900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:03.184900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:03.215408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-44b220f0-5b72-4c82-a40a-63dc01068cfa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 May 26 21:39:03.215961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 581/1156] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:03.222927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:03.223848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:03.230267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:03.230715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:03.231475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:03.231909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:03.260957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc5eb9a6-09fa-45e3-8c18-b8bfe46088f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041906 May 26 21:39:03.261515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 576/1157] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:04.227229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:04.228141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:04.234935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:04.235380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:04.237051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:04.237484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:04.265860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33f35f81-6158-42f5-86ee-cc8091a7698b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042499 May 26 21:39:04.266578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 582/1158] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:04.272946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:04.273881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:04.280337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:04.280828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:04.281593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:04.282033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:04.316699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-05060c8d-dd73-4932-8312-6a6eae5d93b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047619 May 26 21:39:04.317260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 577/1159] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:05.280478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:05.282198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:05.286119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=87 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:05.293051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:05.293609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:05.294447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:05.295020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:05.324904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-43bcd783-da27-4219-ae99-aa3d4b1758ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051156 May 26 21:39:05.325488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 583/1160] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:05.330876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:05.331839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:05.338400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:05.338849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:05.339611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:05.340046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:05.375391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-38b81455-3bcb-478d-b547-dbf5a9e919c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050737 May 26 21:39:05.375963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 578/1161] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:06.337185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:06.338112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:06.344783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:06.345241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:06.346126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:06.346569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:06.376972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96596f8f-4042-4521-ae8d-8d3a56f88117 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 May 26 21:39:06.377553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 584/1162] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:06.388912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:06.389834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:06.396557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:06.397040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:06.397810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:06.398250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:06.428642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ece57b65-37f6-4e91-ac6d-3b730d048c66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043656 May 26 21:39:06.429223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 579/1163] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:07.388771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:07.389696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:07.397238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:07.397719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:07.398491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:07.398927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:07.429076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4814ea81-efdd-4dbf-a6c3-10b11bca05e2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044373 May 26 21:39:07.433354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 585/1164] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:07.439842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:07.440814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:07.447572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:07.448017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:07.448830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:07.449269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:07.479195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a79a80cf-8d96-4d9e-b42c-8d1fae7e2950 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 May 26 21:39:07.479959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 580/1165] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:08.440812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:08.441747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:08.448328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.448817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.449585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.450024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.479875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5d8d49e6-45ea-41f2-9417-07051a913ce2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043078 May 26 21:39:08.480429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 586/1166] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:08.490893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:08.491815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:08.498323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.498774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.499546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:08.499991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:08.529781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d213af5e-1ac3-4e59-b6bc-c2957cbb748b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 May 26 21:39:08.530356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 581/1167] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:09.492888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:09.493821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:09.500472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:09.501614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:09.502393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:09.502837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:09.532861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-804eb4d2-69a7-4e9e-807f-b71fb897d153 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043715 May 26 21:39:09.533431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 587/1168] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:09.541685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:09.542614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:09.550009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:09.550469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:09.551235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:09.551675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:09.586228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c8a1ff2f-412b-491d-bfb1-d73bd86be989 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048571 May 26 21:39:09.586814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 582/1169] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:10.544817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:10.545778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:10.553203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.553657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:10.554446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.554891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:10.585061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8a4f4f31-f7e1-434e-bf87-3900a4533d17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 May 26 21:39:10.585656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 588/1170] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:10.603151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:10.604167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:10.611331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.611779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:10.612542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:10.613016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:10.643633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc2aae81-d934-4428-927e-acec34194bdf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044376 May 26 21:39:10.644277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 583/1171] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:11.597229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:11.598150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:11.604604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:11.605057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:11.605827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:11.606262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:11.635735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5e90b6de-e9b7-42f2-a183-fb671ff5c84b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 May 26 21:39:11.636320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 589/1172] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:11.655091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:11.656053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:11.663200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:11.663668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:11.664513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:11.664981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:11.695098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9f97454a-a1d4-43c1-a6a8-0e2859133887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 May 26 21:39:11.695699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 584/1173] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:12.647626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:12.648550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:12.656184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:12.656666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:12.657977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:12.658409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:12.675385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:12.688410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed45af4a-3e3d-4951-bc4c-0a683d30962f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044713 May 26 21:39:12.689004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 590/1174] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:12.706577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:12.707468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:12.714041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:12.714500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:12.715281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:12.715724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:12.747840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-429dc241-42fc-4b90-8dca-e9f312834962 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 May 26 21:39:12.748404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 585/1175] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:13.699822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:13.700781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:13.708171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:13.708651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:13.709419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:13.709890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:13.738844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d328889e-0358-41f0-8072-e6500cfb49da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 May 26 21:39:13.739395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 591/1176] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:13.759200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:13.760129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:13.762452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=67 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:13.768003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:13.772552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:13.772552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:13.772552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:13.800426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e29e1c45-6701-4432-8942-a18a27a3ffb3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 May 26 21:39:13.801027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 586/1177] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:14.750485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:14.751998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:14.759831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.760279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.761088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.761525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.793404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17ad83e2-f789-4a09-a30d-ec93ffc5b8b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046784 May 26 21:39:14.793982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 592/1178] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:14.811360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:14.812285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:14.819005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.819465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.820247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:14.820723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:14.851473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ed3046a4-214c-47c2-81f7-d4cc45b15d51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 May 26 21:39:14.852052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 587/1179] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:15.804964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:15.805811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:15.812244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.812725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.813991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.814434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.842893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ff325eb-18d8-46a8-8c69-de2812991c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041967 May 26 21:39:15.843440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 593/1180] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:15.863396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:15.864321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:15.871031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.871486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.872260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:15.872728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:15.903065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3744e3b2-d327-4755-9c56-e461f05f1667 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 May 26 21:39:15.903646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 588/1181] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:16.854359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:16.855299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:16.861907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.862353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.863109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.863543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.893994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3509d85f-a8fc-4d96-8fce-72052cc9c3bd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043499 May 26 21:39:16.894623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 594/1182] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:16.914661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:16.915510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:16.922361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.922847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.923684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:16.924114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:16.959754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-32f4f535-b268-42a3-a4be-72b5c9e747b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 May 26 21:39:16.959754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 589/1183] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:17.906007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:17.907458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:17.914081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.914534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.915298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.915730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.947578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-afbe451f-2198-4a6c-b738-0ab7eeffe120 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045471 May 26 21:39:17.948150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 595/1184] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:17.967221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:17.968736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:17.975898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.976351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.977163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:17.977599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:17.980183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:18.010595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b3a828b8-473a-4da8-8ec4-7dab2e57de61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047199 May 26 21:39:18.011178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 590/1185] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:18.959201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:18.960128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:18.966472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.966930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.967704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:18.968149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:18.998270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f6bc3cf5-bad6-4a77-9af5-be8e867736e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 May 26 21:39:18.998850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 596/1186] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:19.022102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:19.023034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:19.029676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.030122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.030949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:19.031415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:19.064058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ab8f2413-c871-4566-8455-1a3974e7ff74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045802 May 26 21:39:19.064664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 591/1187] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:20.015265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:20.017682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:20.026489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.026933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.027707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.028140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.058628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84a4d0a9-9f92-4ab2-a3c7-aa458101b38f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050736 May 26 21:39:20.059215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 597/1188] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:20.076237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:20.076776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:20.083406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.083849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.084636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:20.085071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:20.116007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0a2d6c4f-5f5e-4c28-af50-613a6c3079a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 May 26 21:39:20.116568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 592/1189] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:21.070671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:21.071673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:21.078404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.078850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.079636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.080074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.113917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-971e3528-153b-417e-82a2-8c04486d1f15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046985 May 26 21:39:21.114464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 598/1190] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:21.129161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:21.130102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:21.139203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.139843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.140744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:21.141781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:21.176053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bd173821-0520-48d5-b00d-afe52fcc8cd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051313 May 26 21:39:21.176664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 593/1191] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:22.125673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:22.126636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:22.133164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.133620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.134386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.134829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.164139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-318aa66a-9338-4c84-924c-e827d2d4f4d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042368 May 26 21:39:22.164637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 599/1192] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:22.187212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:22.188133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:22.194843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.195288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.196051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:22.196483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:22.227382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a94cc594-f523-4b91-8924-83429d08daa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 May 26 21:39:22.227946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 594/1193] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:23.176013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:23.176966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:23.183587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.184036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.184849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.185289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.214404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-11fd1f79-e69c-49d8-91cd-8b012522b65e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042736 May 26 21:39:23.214879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 600/1194] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:23.239311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:23.240270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:23.246484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.246927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.247688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:23.248118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:23.277783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9f53368a-7a0a-44c1-8193-1e43268cb3b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 May 26 21:39:23.278337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 595/1195] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:24.231072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:24.232883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:24.244546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:24.245379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.246774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:24.247568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.288132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:24.289444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:24.297904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:24.298363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.299671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:24.300307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:24.308515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e73b7239-638b-45fb-8ede-75802cb45468 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084809 May 26 21:39:24.309688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 601/1196] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:24.332293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bafa8353-4eb7-441f-b0d4-409fafec911b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048054 May 26 21:39:24.332931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 596/1197] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:25.321341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:25.322270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:25.329232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.330258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.331089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.331542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.346807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:25.347768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:25.359896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.360765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.362679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:25.363018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:25.367524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1d7c1f51-2e6f-4a4a-a73c-6699d95a00e0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050505 May 26 21:39:25.368557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 602/1198] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:25.421454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-219c856f-a2bb-4a31-bdd9-bf6e8675baa5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080686 May 26 21:39:25.422050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 597/1199] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:26.380235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:26.381129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:26.387931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.388407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.389215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.389690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.423848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-db0b45df-e3fb-4941-990a-25021fbc60da tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048177 May 26 21:39:26.424553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 603/1200] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:26.434797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:26.435724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:26.443247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.444570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.444819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:26.445239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:26.476922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d35ad623-28c6-427c-8294-83e5768fac57 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046037 May 26 21:39:26.477518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 598/1201] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:27.438163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:27.439011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:27.445762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:27.446214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:27.447098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:27.447544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:27.479844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a1a4651c-2884-4310-97e4-3f3c7f53b7e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045778 May 26 21:39:27.480425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 604/1202] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:27.488933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:27.489868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:27.496086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:27.496535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:27.497338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:27.497776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:27.528117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95eb952e-ca92-4524-a01d-a17fe1ccecce tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 May 26 21:39:27.528710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 599/1203] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:28.491605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:28.492526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:28.499499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.499859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.500671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.501115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.532824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5fd71176-a393-4adf-adcd-93a002f199ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044492 May 26 21:39:28.533723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 605/1204] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:28.542583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:28.543315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:28.550564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.551025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.551820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:28.552267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:28.583343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9ae29632-a078-45ed-ade9-164c2f5be526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 May 26 21:39:28.583917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 600/1205] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:29.543536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:29.544452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:29.551364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:29.551743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:29.552511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:29.553418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:29.588764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a8bd1f03-c2b0-46ba-9b86-4b8c18836144 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048811 May 26 21:39:29.593439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 606/1206] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:29.594984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:29.595921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:29.602610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:29.603053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:29.603824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:29.604254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:29.637660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2f15ecb3-e9bc-4ce9-9f65-64aa38daae38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 May 26 21:39:29.638248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 601/1207] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:30.601852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.602787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.609627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.610002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.610780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.611221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.615611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:30.642678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-403f3cbc-c70e-4e91-9555-f65080f57329 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 May 26 21:39:30.643588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 607/1208] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:30.650568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:30.651431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:30.657411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.657863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.658648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:30.659096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:30.700743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e4fedb7c-5166-419a-822f-cc8a8040013d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053982 May 26 21:39:30.701829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 602/1209] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:31.657440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:31.659348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:31.670570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.671400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.672914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.673725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.712958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:31.713889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:31.718785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84b29203-8504-42f6-9ec6-258b3df58581 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065747 May 26 21:39:31.720442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 608/1210] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:31.721939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.722408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.723402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:31.724002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:31.756310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-220cdbbd-1b6f-4475-8e11-e28061a62155 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 May 26 21:39:31.756916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 603/1211] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:32.732450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:32.733438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:32.741256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:32.741718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:32.742506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:32.742946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:32.767850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:32.768895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:32.776432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:32.777003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:32.777719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:32.778163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:32.794510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-18f43dde-5f65-4169-a7f8-fa527196869c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065869 May 26 21:39:32.795740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 609/1212] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:32.812950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-faacbf38-327b-4651-b0c4-673771d55485 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049245 May 26 21:39:32.813551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 604/1213] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:33.810967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:33.811912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:33.819227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:33.819685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:33.820620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:33.821082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:33.829463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:33.831605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:33.843634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:33.844447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:33.845904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:33.847348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:33.858603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5b9cf000-5c43-4e0d-8309-14904f509fa3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051655 May 26 21:39:33.864998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 610/1214] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:33.901619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95fbcbd1-0be6-4a25-b5b1-9c3a6c1edaf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079626 May 26 21:39:33.902237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 605/1215] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:34.873886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:34.874891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:34.882382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:34.883253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:34.884069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:34.884510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:34.919130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:34.919902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6183e3e5-7cc5-4923-91e8-63af7aaf3902 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050911 May 26 21:39:34.920424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:34.920931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 611/1216] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:34.932356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:34.932848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:34.933645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:34.934090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:34.962004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:34.968572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e6d90c73-b7a6-44b3-adc3-2391f120cab4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056822 May 26 21:39:34.974065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 606/1217] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:35.943632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:35.944624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:35.952009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:35.952445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:35.953278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:35.953728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:35.987314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:35.987945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e8f49063-710f-4a91-bf21-0a2bc3293aad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057519 May 26 21:39:35.988699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 612/1218] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:35.988884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:35.999274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:36.000024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:36.001226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:36.001962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:36.038509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d49f675c-4c64-45be-a179-287f20245e87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058010 May 26 21:39:36.039113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 607/1219] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:37.000172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:37.001523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:37.004074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:37.009672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:37.010171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:37.011000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:37.011481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:37.048142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-027a052d-7f10-43a6-ab6e-057ac510ba4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052393 May 26 21:39:37.049021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 613/1220] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:37.054189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:37.055717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:37.067473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:37.068111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:37.068925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:37.069375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:37.105754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dad9448a-9948-424e-8fde-7ad2fa2ea47b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058435 May 26 21:39:37.106824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 608/1221] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:38.062060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:38.062997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:38.069907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:38.070329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:38.071573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:38.071704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:38.115172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dd3261aa-dfdc-405e-a679-73c86726cd63 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056880 May 26 21:39:38.115896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 614/1222] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:38.124032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:38.125219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:38.132853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:38.133465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:38.134266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:38.134708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:38.168195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e98c5f86-4397-416f-aba2-ccfe0f70b32d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051293 May 26 21:39:38.168808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 609/1223] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:39.130044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:39.130909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:39.137825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.138264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.139051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.139503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.172263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8131d7ff-f290-4a8c-a700-4acec185b0b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 May 26 21:39:39.173133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 615/1224] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:39.179535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:39.180461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:39.187491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.187937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.188771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:39.189204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:39.222870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5f3dc053-900c-421c-bd30-07230143775b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047304 May 26 21:39:39.223461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 610/1225] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:40.186373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:40.187317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:40.194256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.194715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.195500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.195949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.227913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f44a2edf-2a90-426a-8298-1598628c2b3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046246 May 26 21:39:40.228478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 616/1226] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:40.236519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:40.238027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:40.244094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.244554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.245360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:40.245798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:40.277475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4e5e43de-d0f2-45f0-b2af-b0d2d68e1b72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046713 May 26 21:39:40.278060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 611/1227] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:41.240564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:41.241446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:41.248313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.248813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.249603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.250051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.281437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6573c6c3-dab8-4e34-9373-f1532aa976b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 May 26 21:39:41.282032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 617/1228] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:41.298299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:41.299341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:41.307027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.307484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.308263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:41.308732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:41.339807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fa7b5dd9-2a6a-499b-bdca-5753dc7d931a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 May 26 21:39:41.340384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 612/1229] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:42.293540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:42.294661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:42.302318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.302698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:42.303482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.303928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:42.334845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8d0aacd-60d6-4e9d-a5b6-5f8aeb4b011a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 May 26 21:39:42.335248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 618/1230] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:42.354306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:42.355318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:42.362211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.363334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:42.364111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:42.364544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:42.395498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-abcdc5ae-4443-4d93-bc97-1429a59882e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045119 May 26 21:39:42.402504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 613/1231] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:43.346574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:43.348182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:43.355250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:43.355701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.356497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:43.356959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.398968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1a75ef37-fe1c-4de1-96d3-79a4214e1141 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056348 May 26 21:39:43.399809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 619/1232] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:43.412185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:43.413369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:43.420396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:43.420904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.421693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:43.422142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:43.455397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71dbaffc-758e-453c-8359-68f6960a86c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047809 May 26 21:39:43.456528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 614/1233] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:44.411424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:44.412344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:44.419554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.420000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.420943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.421323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.454309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c50e4924-6a62-46ae-8534-cf198535968e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047361 May 26 21:39:44.454935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 620/1234] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:44.467617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:44.468894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:44.471435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=58 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:44.477796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.478253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.479028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:44.479639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:44.518225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7796ca5e-527a-4ef8-a3ec-244a4063eebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054651 May 26 21:39:44.519149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 615/1235] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:45.466603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:45.467678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:45.475661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.476114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.476972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.477416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.508742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f9bc6e43-c666-41f8-971c-42e892aa27aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046495 May 26 21:39:45.509287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 621/1236] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:45.529954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:45.530915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:45.538735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.539188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.539972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:45.540412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:45.573104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d7e0a1bb-de8e-4b85-8323-e474eda36dd8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047031 May 26 21:39:45.573819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 616/1237] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:46.523039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:46.524190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:46.533184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.533787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.534742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.535340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.568378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-81875343-6d53-4ac1-9ac5-8baa5e02e5e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050144 May 26 21:39:46.569001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 622/1238] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:46.584898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:46.585755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:46.592622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.593094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.593875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:46.594310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:46.627307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf545bda-d7e8-4606-8857-553b62d7cf72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 May 26 21:39:46.627923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 617/1239] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:47.580280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:47.581253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:47.588378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.588859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.589624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.590064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.615252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:47.619618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e605525a-dcef-4034-b4de-e29dc96e443f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043369 May 26 21:39:47.620185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 623/1240] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:47.638738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:47.639789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:47.647063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.647522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.648297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:47.648771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:47.680155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a5c6c06c-591a-4c3c-9aea-af9734d52f74 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 May 26 21:39:47.680901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 618/1241] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:48.632363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:48.633327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:48.640122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.640851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:48.641642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.642083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:48.673910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b96930a8-60c2-470d-ae50-dcbe75c4269a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046060 May 26 21:39:48.674416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 624/1242] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:48.692120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:48.693079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:48.699905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.700363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:48.701167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:48.701607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:48.734873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f84f5b66-67a3-45c5-9a5b-c82c7163c983 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047513 May 26 21:39:48.735462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 619/1243] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:49.686095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:49.687021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:49.694130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:49.694582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:49.695352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:49.695798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:49.726576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f01b5b5-58a0-4996-a080-8a96aa49c729 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 May 26 21:39:49.727079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 625/1244] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:49.746193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:49.747124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:49.754175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:49.754629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:49.755431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:49.755871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:49.785755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbaf06f0-9ba5-497c-8a1e-552055705559 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 May 26 21:39:49.786334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 620/1245] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:50.738379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:50.739314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:50.745992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.746446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.747219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.747660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.778089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-091d5f19-ec09-4cfd-97ce-5bd7edd605d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 May 26 21:39:50.778587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 626/1246] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:50.799513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:50.800874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:50.808725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.809264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.810322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:50.810858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:50.842752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ec140078-017b-4d62-9ee0-7ca2229be083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048863 May 26 21:39:50.843371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 621/1247] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:51.790280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:51.791255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:51.797996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.798452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.799229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.799673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.830216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-904e5728-03c4-460b-8b64-9be397549cc6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044356 May 26 21:39:51.830705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 627/1248] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:51.855405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:51.856338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:51.865205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.865656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.866429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:51.866868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:51.897273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-28664515-e45b-4be5-a6b0-ff8819a29cf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045933 May 26 21:39:51.897845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 622/1249] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:52.447834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:39:52.448115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:39:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:39:52.845387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:52.846317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:52.852926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.853383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.854151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.854593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.885000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3536abd0-e9a9-4dce-821a-115a38390092 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043497 May 26 21:39:52.885624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 628/1250] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:52.908811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:52.909741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:52.916610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.917066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.917858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:52.918294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:52.933448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:39:52.950308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ca46cfa-a877-41ef-8a15-620a6e67a2df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045453 May 26 21:39:52.950877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 623/1251] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:53.897552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:53.898578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:53.905223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.905679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.906470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.906907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.939490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a2925998-3307-42ec-bae0-b409391eee27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046433 May 26 21:39:53.940086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 629/1252] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:53.964571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:53.966109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:53.974085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.974539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:53.975909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:53.976352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:54.008335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4319eca4-c72a-4608-9260-5fb12fee6d04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049539 May 26 21:39:54.008964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 624/1253] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:54.951396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:54.952328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:54.959716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:54.960165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:54.960975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:54.961415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:54.995966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-32406aa8-bdd5-4f78-b9c2-70086874a227 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048085 May 26 21:39:54.996431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 630/1254] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:55.021138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:55.022077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:55.029534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:55.030067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:55.030858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:55.031297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:55.064424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c3398758-1616-4356-a1a2-6d7a21aaeeb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047216 May 26 21:39:55.064955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 625/1255] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:39:56.008789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:56.009726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:56.017010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:56.017477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:56.018275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:56.018713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:56.050757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7f6549fb-b11b-4c2f-a18a-9a928dd65afb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046626 May 26 21:39:56.051354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 631/1256] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:56.076078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:56.077093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:56.084210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:56.084700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:56.085489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:56.085937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:56.119316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61a681f0-1f20-4061-9011-6ac9de1f7c01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 May 26 21:39:56.119316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 626/1257] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:57.064801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:57.065735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:57.073355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:57.073809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:57.074716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:57.075164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:57.106418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-24e79bfd-9d3f-4c7b-926c-30b5b5a81ad4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 May 26 21:39:57.107018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 632/1258] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:57.130679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:57.133015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:57.141498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:57.141498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:57.142115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:57.142649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:57.180447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d8f391a7-1fdd-4ae2-a2b6-0cf43bac98aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053782 May 26 21:39:57.181102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 627/1259] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:58.122220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:58.128094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:58.130092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:58.130540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:58.131330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:58.131796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:58.164508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5afe5e30-5f34-470e-b2d3-e29c2e35bb89 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 May 26 21:39:58.164508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 633/1260] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:58.192771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:58.193891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:58.201075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:58.201537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:58.202437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:58.202885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:58.238747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8ce00675-8135-4645-8c69-fdd8c6db881f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050009 May 26 21:39:58.239338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 628/1261] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:59.175178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:59.176140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:59.182728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:59.183200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:59.183970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:59.184399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:59.216814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-64753709-332c-4b80-8dd7-f7a771a07631 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 May 26 21:39:59.217399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 634/1262] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:39:59.249821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:39:59.250779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:39:59.257051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:59.257503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:59.258810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:39:59.259250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:39:59.290050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-76c38124-a7b2-4071-ac94-fe10c658d6d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043640 May 26 21:39:59.290613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 629/1263] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:39:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:00.228525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:00.232252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:00.235627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:00.236078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:00.236918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:00.237359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:00.269318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2518a760-e22d-4ac1-98fc-12f623da3486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045771 May 26 21:40:00.269967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 635/1264] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:00.301545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:00.302457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:00.310471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:00.310986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:00.311805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:00.312392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:00.341812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3db1f2d-d91d-402b-8a04-a536f1080c02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 May 26 21:40:00.342396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 630/1265] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:01.283483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:01.284393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:01.291100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:01.291548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:01.292384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:01.292808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:01.325610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5cb8250-b2d8-403d-bced-737dcf306a07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046097 May 26 21:40:01.326228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 636/1266] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:01.353296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:01.354230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:01.360669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:01.361128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:01.361893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:01.362337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:01.392813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-678bc4b8-ee6d-4863-8b3c-c79f8fad4283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 May 26 21:40:01.393374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 631/1267] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:02.337898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:02.338831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:02.345606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:02.346058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:02.346840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:02.347280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:02.379467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b51e8925-f8ea-4b26-9658-2906171770ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044707 May 26 21:40:02.379467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 637/1268] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:02.404226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:02.405081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:02.412276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:02.412777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:02.413552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:02.414024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:02.442981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7937db85-3493-4d97-a697-2b7b20d82637 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042871 May 26 21:40:02.443543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 632/1269] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:03.389737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:03.390930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:03.397431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:03.397890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:03.398663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:03.399628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:03.431150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-757e698f-41e1-428c-a9e2-7e9c05ec3dfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 May 26 21:40:03.431745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 638/1270] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:03.455255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:03.456359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:03.463558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:03.464010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:03.464813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:03.465259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:03.494536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4fa91d2e-3445-4696-9570-0df36c1fa3bf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043191 May 26 21:40:03.495104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 633/1271] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:04.443349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:04.444288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:04.450984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.451441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.452248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.452718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.484312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a891fb2-037b-4293-a497-b0120c057d3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 May 26 21:40:04.484923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 639/1272] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:04.506239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:04.507492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:04.509697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:04.510530 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:04.521672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.521672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.521672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.521672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.521988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.521988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.521988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:04.521988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:04.534366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:04.545789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f52db61f-df15-4498-aefc-0b4212d3ab9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7/ips" status: 200 len: 151 microversion: 2.20 time: 0.043979 May 26 21:40:04.546472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 634/1273] 10.222.0.66 () {60 vars in 1288 bytes} [Thu May 26 21:40:04 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:40:04.547780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-36dc4cc1-b432-4a98-a4b8-61f60b988f5a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045630 May 26 21:40:04.548355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 640/1274] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:05.495300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:05.496247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:05.502469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:05.502922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:05.503693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:05.504131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:05.535526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a82b55a7-36c2-4a13-872d-22314ef7a9bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044096 May 26 21:40:05.536159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 635/1275] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:05.562118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:05.563289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:05.570537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:05.571651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:05.572566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:05.573126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:05.604050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0c15f671-9f8c-4384-8c56-ac776aa88816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048490 May 26 21:40:05.606054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 641/1276] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:06.547437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:06.548401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:06.555468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:06.566486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:06.566486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:06.566486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:06.590705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8e8cad12-d245-49f4-9c6f-8357788d486e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047262 May 26 21:40:06.591340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 636/1277] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:06.617577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:06.618543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:06.626653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:06.626977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:06.627817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:06.628236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:06.662914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5375387f-fdae-41f1-b6b2-c6610587a044 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 May 26 21:40:06.663358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 642/1278] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:07.602531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:07.603491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:07.610116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:07.610565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:07.611427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:07.611864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:07.642510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-006b92d6-0743-4220-8841-0a13138a075c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044172 May 26 21:40:07.643294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 637/1279] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:07.675502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:07.676616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:07.678991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:07.684174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:07.684553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:07.685355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:07.685791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:07.715977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61061b81-a69f-49a8-bac8-136612ab3a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044445 May 26 21:40:07.716532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 643/1280] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:08.654422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:08.655420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:08.662121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:08.662575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:08.663339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:08.663777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:08.693411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7707a92e-2eae-4054-acd8-9101b494b392 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042925 May 26 21:40:08.693981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 638/1281] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:08.731831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:08.733603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:08.742129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:08.742529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:08.743304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:08.743754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:08.774371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8a0752bb-d70e-4fa8-9f3b-85942fe3ceef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050593 May 26 21:40:08.774939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 644/1282] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:09.704349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:09.705307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:09.712366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:09.712860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:09.713695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:09.714136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:09.748840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f4deda46-f736-445f-ac14-631abe252489 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 May 26 21:40:09.749662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 639/1283] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:09.786356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:09.787286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:09.793956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:09.794463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:09.795194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:09.795620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:09.824836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fd1a0421-5816-4e5c-a56d-085e46963150 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042300 May 26 21:40:09.825404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 645/1284] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:10.759979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:10.760922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:10.768393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:10.769087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:10.769658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:10.770100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:10.783759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:10.799532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cb7f720c-b95b-4e58-b99d-eb34debd4f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 May 26 21:40:10.800105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 640/1285] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:10.835469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:10.836411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:10.843216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:10.843672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:10.844492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:10.845004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:10.874693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b0bf8a4e-00ad-4709-8427-a13fe0d14b42 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043214 May 26 21:40:10.875253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 646/1286] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:11.811579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:11.812414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:11.819302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:11.819744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:11.820488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:11.820941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:11.850051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a5b465ea-ee51-4e9d-aae1-92b5a608fe15 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042950 May 26 21:40:11.850616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 641/1287] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:11.885375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:11.886421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:11.893590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:11.894048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:11.894828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:11.895263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:11.924906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b025ae10-af95-4e72-b689-fc0ddf9070af tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 May 26 21:40:11.925461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 647/1288] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:12.861700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:12.862714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:12.869226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:12.869682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:12.870443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:12.870931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:12.901324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d7ca5fe-c206-44fc-8838-768c5d5c797b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 May 26 21:40:12.906451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 642/1289] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:12.937142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:12.938061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:12.944914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:12.945376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:12.946222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:12.946639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:12.977578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-270535bf-847d-4b26-b3b4-86989a953812 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 May 26 21:40:12.978144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 648/1290] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:13.914140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:13.915066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:13.921562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:13.922020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:13.922785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:13.923226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:13.954224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eafdbb40-6dfb-42fe-9020-383ddc49cc3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 May 26 21:40:13.954551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 643/1291] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:13.989676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:13.990610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:13.997825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:13.998283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:13.999059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:13.999502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:14.030532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1da31da5-ee5a-479b-ad07-736d79bfd91a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 May 26 21:40:14.031013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 649/1292] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:14.966587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:14.967510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:14.973995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:14.974446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:14.975201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:14.975640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:15.004540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78e9ce68-7fcc-4a83-871b-0b81d34540b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042505 May 26 21:40:15.005135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 644/1293] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:15.043310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:15.044274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:15.051129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:15.053259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:15.053259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:15.053259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:15.082413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-391ae487-6fb6-42d0-9135-9816135e726b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043071 May 26 21:40:15.082897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 650/1294] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:16.017022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:16.017953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:16.020253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:16.025042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:16.025500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:16.026277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:16.026730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:16.055763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d434d7e7-86d3-4844-a304-785c2b74238c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 May 26 21:40:16.056334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 645/1295] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:16.093928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:16.094848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:16.101447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:16.104003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:16.104003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:16.104003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:16.132945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c262f641-980e-406f-981c-b6b172c5c9cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042961 May 26 21:40:16.133431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 651/1296] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:17.068446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:17.069412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:17.076744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:17.077189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:17.077945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:17.078376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:17.108382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-01dc7d0e-a3c3-4c3f-aa01-5dca1df1eb1a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 May 26 21:40:17.108980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 646/1297] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:17.151645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:17.152608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:17.159061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:17.159566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:17.160249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:17.160717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:17.194441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d0fcdbf4-e19d-40d7-b7f9-d53401238f63 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043666 May 26 21:40:17.194441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 652/1298] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:18.120181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:18.121727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:18.128315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:18.128797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:18.129549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:18.129979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:18.160750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-63a785ae-d7da-4527-8339-bc44f00ada84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044507 May 26 21:40:18.161368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 647/1299] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:18.203698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:18.204802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:18.211324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:18.211769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:18.212805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:18.213042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:18.243551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a3ed3386-b279-45e4-8b62-092aefebf17d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044013 May 26 21:40:18.244113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 653/1300] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:19.172989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:19.173955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:19.180398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:19.180883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:19.181645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:19.182095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:19.210464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c666335b-0839-4cbf-b3e4-29e3ea5a0aa4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041490 May 26 21:40:19.211203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 648/1301] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:19.255208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:19.256157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:19.262296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:19.262745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:19.263513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:19.263948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:19.294317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61a5c59b-fba2-4a53-8588-6fdcea5d432e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043157 May 26 21:40:19.294869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 654/1302] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:20.222470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:20.223461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:20.230522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:20.230973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:20.231731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:20.232195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:20.262140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3277910f-0c00-4247-997b-c9ab3b18917d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043048 May 26 21:40:20.262707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 649/1303] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:20.305616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:20.307349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:20.315547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:20.316030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:20.316837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:20.317308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:20.346032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0721efe5-a2cd-4b7f-a00a-641520bf12be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 May 26 21:40:20.346590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 655/1304] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:21.273513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:21.274456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:21.281207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:21.281660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:21.282426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:21.282870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:21.311947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-316a2814-bea6-4c3f-9886-052e8b773cc0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042310 May 26 21:40:21.312516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 650/1305] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:21.357355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:21.358465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:21.365108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:21.365558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:21.366324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:21.366802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:21.397465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b657895c-bfa7-49be-b2c7-9b049bbac5eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 May 26 21:40:21.398013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 656/1306] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:22.324221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:22.325228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:22.331867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.332318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.333153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.333591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.365703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-69821dbd-e300-44c8-a8a4-2ef414089e0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046167 May 26 21:40:22.366501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 651/1307] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:22.410056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:22.411225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:22.420636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.421108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.421891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:22.422480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:22.426640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:22.457679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-63ed0472-6c5b-4171-b1ae-126417b54b04 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052384 May 26 21:40:22.458187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 657/1308] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:23.377883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:23.378825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:23.385294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.385743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.387026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.387460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.418561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61595419-f24b-439c-8455-0411f4848d87 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 May 26 21:40:23.419136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 652/1309] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:23.470596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:23.471951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:23.479115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.479592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.480371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:23.480844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:23.516614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1b84bf1-7805-417d-bfe2-cd07db64d653 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050457 May 26 21:40:23.517214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 658/1310] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:24.430250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:24.431174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:24.438488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.438943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.439721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.440157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.470526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7acf0391-4970-4ee2-a15b-f966ba562e22 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044154 May 26 21:40:24.471110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 653/1311] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:24.531454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:24.531454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:24.535411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.535863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.536658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:24.537094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:24.568453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-23aecfe9-01c0-4eb5-969c-014bb56bd35c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044788 May 26 21:40:24.569187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 659/1312] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:25.483311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:25.484260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:25.492126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.496304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.496304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.496304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.528934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0a2fd7ec-1b91-4942-821c-8c7563e3bad3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050935 May 26 21:40:25.529512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 654/1313] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:25.590245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:25.590245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:25.593478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.594077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.595102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:25.595738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:25.641474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6942b5df-43af-49ba-bd40-7c60015d9308 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065397 May 26 21:40:25.642375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 660/1314] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:26.541205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:26.542669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:26.549354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.549808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.550595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.551031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.582328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e7465c6f-d5ee-4d89-a317-d98103c0b9e9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044897 May 26 21:40:26.582896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 655/1315] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:26.653392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:26.654326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:26.661101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.661569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.662351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:26.662785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:26.703002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d5a8dad5-80d8-453e-986d-843a3d1d9a4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053235 May 26 21:40:26.703792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 661/1316] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:27.594892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:27.595821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:27.601938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.602575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.603156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.603597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.633861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0b5e4d91-9417-4d7a-862d-2f3d782efa2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043076 May 26 21:40:27.634493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 656/1317] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:27.716419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:27.717393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:27.724132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.724574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.725377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:27.725808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:27.760764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-69552bd4-b6de-4102-8b6d-a671a6d700c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049085 May 26 21:40:27.761904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 662/1318] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:28.645369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:28.646293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:28.653553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:28.653977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:28.654743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:28.655180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:28.658802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:28.695273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0dc69fd0-dbb2-4720-9320-0d6bfea293f3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053926 May 26 21:40:28.695858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 657/1319] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:28.774163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:28.775086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:28.782272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:28.782716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:28.783489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:28.783917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:28.815047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8370a536-aa34-4c43-af5f-3eb52a70e8b8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044770 May 26 21:40:28.815510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 663/1320] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:29.707591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:29.708504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:29.715192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:29.715642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:29.716406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:29.716873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:29.749168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6e482d19-77c5-42cf-a366-4ac7c477883b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045467 May 26 21:40:29.749801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 658/1321] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:29.827488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:29.828894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:29.836246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:29.836738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:29.841893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:29.841893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:29.872775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f9698fc7-cff1-4b4d-852b-396810573731 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050574 May 26 21:40:29.873524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 664/1322] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:30.761006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:30.762392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:30.769795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:30.770303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:30.771117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:30.771557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:30.804076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24fbf392-a78a-4590-815a-f507ea231d9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 May 26 21:40:30.804848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 659/1323] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:30.884940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:30.885938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:30.893106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:30.893106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:30.893804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:30.894274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:30.934297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-53678b47-dccd-4be3-8177-e8fa641ac8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053418 May 26 21:40:30.934875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 665/1324] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:31.822178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:31.822720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:31.834089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.834806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.835635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.836080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.867467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2dc1251-a7ae-4edf-a156-22c63208df78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054485 May 26 21:40:31.868054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 660/1325] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:31.946150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:31.947070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:31.954570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.955026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.955798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:31.956242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:31.988837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a90ddae1-a7a2-485b-a526-329ee17a8ce5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 May 26 21:40:31.989417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 666/1326] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:32.880262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:32.881236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:32.888762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:32.889217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:32.890267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:32.890714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:32.922807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ac1e56e-7eb9-4e85-808d-64ac0e651e27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046300 May 26 21:40:32.923628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 661/1327] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:33.000714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:33.001655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:33.008504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:33.008998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.009787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:33.010238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.044004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-12c2051c-2cda-4e47-b27b-f8ef284b77e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047627 May 26 21:40:33.044590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 667/1328] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:33.936648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:33.937296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:33.944402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:33.944886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.945668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:33.946108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:33.980201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-17a51ca5-68b8-43b5-82e3-9fec4a030c9a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 May 26 21:40:33.980788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 662/1329] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:34.056883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:34.057882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:34.064687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.065142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:34.065927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.066371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:34.097771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-259a0df5-a6f1-48e3-a44a-81c295f13d6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046186 May 26 21:40:34.098352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 668/1330] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:34.991858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:34.992824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:34.999356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:34.999805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.000703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.001138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.032193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d325f600-4f3f-4a9d-a73c-6c974cf1b1ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044498 May 26 21:40:35.032875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 663/1331] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:35.110129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:35.111098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:35.118365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.118656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.119529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:35.120004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:35.151137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-423b242b-84f3-4f5c-a795-30c208f93614 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 May 26 21:40:35.152262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 669/1332] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:36.043931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:36.044886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:36.051518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.052076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.052757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.053192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.082084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eb1846fc-0a8a-4279-9515-41d8dbaa1da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042630 May 26 21:40:36.082663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 664/1333] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:36.164991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:36.166459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:36.174521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.174968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.175813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:36.176192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:36.206352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-769edc9e-6539-4925-975d-08d5ea5469b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046330 May 26 21:40:36.206929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 670/1334] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:37.093418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:37.094344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:37.101147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:37.101604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:37.102381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:37.102829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:37.136829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a7e62a50-0276-4e64-b757-f06226ee8434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047453 May 26 21:40:37.137441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 665/1335] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:37.218328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:37.219247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:37.225918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:37.226370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:37.227143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:37.227575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:37.257573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7540660c-1e38-4879-95d8-ad1a974a5582 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043257 May 26 21:40:37.258929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 671/1336] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:38.149180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:38.150120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:38.156943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:38.157399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:38.158396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:38.158847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:38.192663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-60cd277b-5e59-4685-8b21-99a95e732e6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047874 May 26 21:40:38.193235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 666/1337] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:38.269498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:38.270430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:38.272971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:38.278787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:38.279350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:38.286187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:38.286187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:38.316881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e994afab-90d4-43c4-be9c-47a4ecf5a050 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051078 May 26 21:40:38.317495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 672/1338] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:39.203629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:39.204609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:39.211243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:39.211697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:39.212477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:39.212942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:39.243974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-12c43adf-0d33-413c-acc7-41712754128a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044274 May 26 21:40:39.244906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 667/1339] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:39.329420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:39.330417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:39.337180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:39.337638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:39.338416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:39.339448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:39.367054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:39.371871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-448aeae6-bad9-4470-8351-aa127150185a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046460 May 26 21:40:39.372452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 673/1340] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:40.256406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:40.259318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:40.264019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:40.264772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:40.265532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:40.265967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:40.298470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cff1e780-6fc2-4d45-a2fa-cad8ffa0e6aa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046532 May 26 21:40:40.299050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 668/1341] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:40.383318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:40.384895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:40.392341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:40.392833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:40.393620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:40.394060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:40.426434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f14d75aa-d938-4df1-8710-7e52841096eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046961 May 26 21:40:40.427006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 674/1342] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:41.310463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:41.318538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:41.318538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:41.318808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:41.319442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:41.319813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:41.355051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-58026ca1-a689-46bf-87c7-7b125722e1b1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047915 May 26 21:40:41.366640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 669/1343] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:41.439423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:41.440525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:41.449257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:41.449786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:41.450673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:41.451512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:41.485133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d925dc80-499f-412f-8017-9707733b58fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049785 May 26 21:40:41.485724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 675/1344] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:42.374305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:42.375257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:42.382512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:42.382988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:42.383779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:42.384222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:42.422722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4a96ed2e-96bc-4636-a327-9432183987bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052655 May 26 21:40:42.423305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 670/1345] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:42.498106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:42.499680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:42.507782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:42.508265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:42.509072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:42.509509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:42.542299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-786e9d6b-26a5-40ae-b9dd-b4b00b720b98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048633 May 26 21:40:42.542870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 676/1346] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:43.435034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:43.435978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:43.445328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:43.445772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:43.446797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:43.447420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:43.484757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-658e6135-b300-45e0-af03-4e80d8ff07c6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054207 May 26 21:40:43.485590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 671/1347] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:43.556882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:43.560372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:43.570317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:43.571101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:43.572692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:43.576209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:43.611069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c46c696-8c17-476e-b1df-8cafcfa1d2c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060657 May 26 21:40:43.616528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 677/1348] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:44.495571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:44.496637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:44.507741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:44.508574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:44.509993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:44.510777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:44.565146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1979af20-db21-4de0-a757-d108d92aa486 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073480 May 26 21:40:44.568819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 672/1349] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:44.624626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:44.625578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:44.632963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:44.633411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:44.634401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:44.634837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:44.669023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3e5bffde-d84e-4d5f-b53e-25726374ec7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049160 May 26 21:40:44.669604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 678/1350] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:45.576722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:45.578198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:45.585745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:45.586195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:45.586967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:45.587401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:45.613439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:45.618155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9e4f837f-700d-47fc-b68e-4760c8d00a02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045644 May 26 21:40:45.618750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 673/1351] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:45.683792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:45.684871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:45.694616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:45.694616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:45.694616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:45.694616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:45.727052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-74bbcfc2-a9ff-4fad-a0d4-ca9a54868892 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048121 May 26 21:40:45.727644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 679/1352] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:46.631522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:46.632446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:46.640534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:46.641019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:46.641789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:46.642226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:46.679328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-91425be2-253d-4b8c-ab64-48727b653d4a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051282 May 26 21:40:46.680376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 674/1353] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:46.741619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:46.742921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:46.752036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:46.752487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:46.753296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:46.753924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:46.787898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c33177e0-9e29-4a69-a0b1-08d855de669c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051593 May 26 21:40:46.788774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 680/1354] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:47.692369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:47.693352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:47.695908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:47.702632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:47.703150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:47.703952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:47.704394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:47.743131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c74489ff-356d-4cdb-8ffb-931272c35ce5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055091 May 26 21:40:47.743746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 675/1355] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:47.811727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:47.812732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:47.820424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:47.820902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:47.821720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:47.822158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:47.855162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1fe11e5c-3ffa-4120-b5c3-81c60e4f3e6e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058848 May 26 21:40:47.855758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 681/1356] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:48.756081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:48.757054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:48.763794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.768489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.768489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.768489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.796992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a1d93214-bcb9-4f01-a8f3-0686e4fcdfa0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 May 26 21:40:48.797573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 676/1357] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:48.866835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:48.867762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:48.874244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.874691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.875463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:48.875906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:48.906869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed99c823-e64e-4250-b010-4ba2a2bf2d29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043907 May 26 21:40:48.907423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 682/1358] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:49.809201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:49.810184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:49.818216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.818679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.819504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.819940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.853083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c65c08b-331a-4c27-85ee-cfa5cb69eafa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048238 May 26 21:40:49.853775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 677/1359] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:49.920140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:49.921214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:49.928144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.928615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.929531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:49.929860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:49.959488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1c1f8b9-d78e-4cba-af4a-77abdab177fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045928 May 26 21:40:49.960049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 683/1360] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:50.866346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:50.867292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:50.874897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.875352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:50.876137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.876576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:50.909217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3953318b-cf5f-418c-ab4b-ad9bd11772d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046825 May 26 21:40:50.909813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 678/1361] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:50.971883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:50.972845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:50.979364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.979820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:50.981369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:50.981801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:51.014105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-198f7350-de7b-452f-a793-a2f75ee6c643 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045849 May 26 21:40:51.014834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 684/1362] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:51.921808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:51.922729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:51.929370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:51.929824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:51.930591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:51.931074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:51.962177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44c32c87-2331-4a0a-8191-4612a19c2e9c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 May 26 21:40:51.962833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 679/1363] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:52.027128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:52.028066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:52.034224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.034715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:52.035469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.035910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:52.068108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de6083fa-b0bf-4f41-9f44-109a09583a1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045753 May 26 21:40:52.068710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 685/1364] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:52.975004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:52.975920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:52.983704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.984294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:52.985099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:52.985533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:53.018245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-07facbbd-73fb-46a1-8fdb-c7a1a116116c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047360 May 26 21:40:53.018849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 680/1365] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:53.080203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:53.081182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:53.087984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:53.088445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:53.089362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:53.089810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:53.123291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4f94e767-cbda-4da6-94eb-9c39e6d363be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047082 May 26 21:40:53.123861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 686/1366] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:54.031160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:54.032077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:54.038538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.038998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.039806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.040234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.070119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-646cb51b-1635-4dfd-851c-2f5f3b2dd87c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 May 26 21:40:54.070681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 681/1367] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:54.136644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:54.137597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:54.145104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.145229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.146277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:54.146719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:54.182256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2902a23b-acb3-4ba4-b716-5acf3b5b6bdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050714 May 26 21:40:54.182778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 687/1368] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:40:55.081727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:55.082644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:55.089009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.089453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.090261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.091297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.119995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7e95027a-7517-4300-bab5-b86dd21d654b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042136 May 26 21:40:55.120557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 682/1369] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:55.195511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:55.196434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:55.203366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.203816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.204612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:55.205104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:55.236701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37ab3f1c-7c9d-4fb9-b1bf-bad9fd08e526 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 May 26 21:40:55.237276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 688/1370] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:56.131295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:56.132227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:56.139926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.140378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.141197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.141632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.170269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-05107e8e-1eb6-4973-a1b8-7e541d6fb2a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042790 May 26 21:40:56.170853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 683/1371] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:56.248474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:56.249538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:56.256286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.256776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.257547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:56.257987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:56.288258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a7b2410e-3df1-461a-9ca2-242ecf549f80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 May 26 21:40:56.288858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 689/1372] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:57.181720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:57.182693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:57.189271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.189722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.190501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.190938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.226608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fd06bf83-c45d-4c5e-aa16-f7e4b0cc9eb8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045239 May 26 21:40:57.226608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 684/1373] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:57.300226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:57.301285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:57.308058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.308511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.309379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:57.309807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:57.332743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:40:57.347132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-be0a0233-b5e2-4f06-9c29-9e7606b4e573 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050805 May 26 21:40:57.351563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 690/1374] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:58.234496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:58.235968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:58.242503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.242949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.243715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.244153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.276604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1891c4eb-74e6-4e72-8ab0-df8e7b4bc600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045722 May 26 21:40:58.277572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 685/1375] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:58.362439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:58.363358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:58.370578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.371171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.372501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:58.372962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:58.402493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f201954b-234b-4ec1-aa5f-5b70ad6fffa0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 May 26 21:40:58.403568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 691/1376] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:59.288185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:59.289211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:59.296619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.296827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.305403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.305403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.328575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ebc67ef-fcad-4e70-81d5-7deae7482bda tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044372 May 26 21:40:59.329146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 686/1377] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:40:59.414637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:40:59.415710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:40:59.422721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.423184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.423967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:40:59.424411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:40:59.457815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fabbda6a-1023-4c29-917e-bb0775df83d0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047044 May 26 21:40:59.458597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 692/1378] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:40:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:00.340996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:00.341926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:00.348349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:00.348832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:00.349612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:00.350050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:00.378958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ed3e109-eef0-45e0-a1cc-5d9243588c9f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042500 May 26 21:41:00.379524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 687/1379] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:00.470153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:00.470887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:00.479815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:00.479815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:00.479815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:00.479815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:00.508688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c2208f1-220c-4ac6-b639-ae196fa7ae89 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043079 May 26 21:41:00.509304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 693/1380] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:01.390629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:01.391550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:01.397978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.398294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.399112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.399640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.429069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e6acd635-6831-431d-94e5-ef398f64fc02 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043198 May 26 21:41:01.429642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 688/1381] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:01.520331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:01.521949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:01.529007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.529457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.530338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:01.530696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:01.553196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:41:01.553410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:41:01.568374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71d1b3f5-5bc0-41fc-8265-135debc60cae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051071 May 26 21:41:01.568532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 694/1382] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:02.441457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:02.442396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:02.449251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.449767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.450562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.451010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.497874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8f09927a-7881-4557-b2d2-1ed4ad32bbd4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060598 May 26 21:41:02.498457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 689/1383] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:02.580894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:02.581871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:02.589990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.590449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.591807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:02.592250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:02.624981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c8e70172-d525-42c6-bc29-da7d122c2d4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048391 May 26 21:41:02.625832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 695/1384] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:03.509909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:03.510865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:03.518454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.518899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.519673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.520103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.534563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:03.551142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6f008fdd-2ec3-47e5-9462-8dbab905c844 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044651 May 26 21:41:03.551142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 690/1385] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:03.636406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:03.637375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:03.645445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.645906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.646698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:03.647142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:03.681875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98086010-bd1c-499c-afd0-364212f5320b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049206 May 26 21:41:03.682484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 696/1386] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:04.562791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:04.563728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:04.570696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.571153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.571953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.577405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.603391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-99db82be-3442-4398-a4f0-9cb4152d7c32 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045003 May 26 21:41:04.603951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 691/1387] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:04.694079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:04.695069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:04.702769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.703154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.703915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:04.704347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:04.733610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8eccf543-7fe8-4a97-8944-7f7dec85d7c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 May 26 21:41:04.734168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 697/1388] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:05.615487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:05.616600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:05.622968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.623409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.624170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.624623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.654994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d8cf1564-71ec-4491-87d6-30a48e172d40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 May 26 21:41:05.655567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 692/1389] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:05.745066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:05.746087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:05.753160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.753711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.754604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:05.755132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:05.799317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7241ce10-1507-4e7b-ae84-039646deeed9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058036 May 26 21:41:05.803709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 698/1390] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:06.666678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:06.667604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:06.674486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:06.674945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:06.675727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:06.676168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:06.708397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9f5f112-ba22-46de-8ea0-156e1a10f7ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045629 May 26 21:41:06.709014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 693/1391] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:06.817344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:06.817344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:06.823138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:06.823698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:06.824549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:06.825029 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:06.857637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de510c7a-eeae-4ed3-885c-238352df9bca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049989 May 26 21:41:06.858221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 699/1392] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:07.720274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:07.721254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:07.728184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.728545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.729350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.729802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.765734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7e282320-3a2b-448c-8701-8bdb8ec088d9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049512 May 26 21:41:07.766330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 694/1393] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:07.869596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:07.870682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:07.877745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.878277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.879055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:07.879484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:07.921066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-88bf4239-bcbb-486d-82a0-317ada0f2da7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055482 May 26 21:41:07.921623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 700/1394] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:08.777744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:08.779258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:08.785773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.786226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.786999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.787437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.817139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9a3e2813-b344-4c56-ba82-ee8467ea78af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 May 26 21:41:08.817638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 695/1395] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:08.933349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:08.935012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:08.937543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:08.942899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.943568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.944505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:08.945021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:08.978012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eb874b3e-6f1d-447a-84f5-fb9ebdef56eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049172 May 26 21:41:08.978593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 701/1396] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:09.829043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:09.829991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:09.836727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:09.837188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:09.837972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:09.838415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:09.870615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2b19b4f-7103-40bb-83b4-7d914cc9e8c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045713 May 26 21:41:09.871209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 696/1397] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:09.991327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:09.992299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:10.005842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:10.005842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:10.005842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:10.005842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:10.037830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2f1ab250-1c90-4c35-baa1-d6a4b27252a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051077 May 26 21:41:10.038790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 702/1398] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:10.882287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:10.883133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:10.890053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:10.890507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:10.891289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:10.891733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:10.922227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ebca3abc-846d-4320-9906-108ca99f52ae tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043968 May 26 21:41:10.922805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 697/1399] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:11.051486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:11.053133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:11.060815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.061261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.062047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.062829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.097600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2da32147-d0e4-413d-b95f-5703d67f3867 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049932 May 26 21:41:11.098518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 703/1400] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:11.870397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:41:11.870608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:41:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:41:11.933904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:11.935310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:11.941736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.942178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.942926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:11.943354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:11.973080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-02caf4c6-789e-4a1b-8d14-ba0445e885b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 May 26 21:41:11.974084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 698/1401] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:12.111266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:12.112184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:12.118623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.119067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:12.119816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.120249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:12.149999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c65d44e2-6e7c-49da-ae36-27389f864492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042533 May 26 21:41:12.150554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 704/1402] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:12.984707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:12.985565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:12.992048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.992499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:12.993295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:12.993736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:13.022592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c41c0bcc-49b5-4a53-9380-1f3d6a922c85 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042482 May 26 21:41:13.023144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 699/1403] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:13.161460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:13.162514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:13.169548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:13.170003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:13.170768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:13.171210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:13.200869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-23399a34-5dc9-46bd-b954-23f4174332db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043202 May 26 21:41:13.201451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 705/1404] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:14.034673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:14.035592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:14.042494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.042958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.043767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.044236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.072644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f94db62b-e571-4b4f-aede-a9827dddbf54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 May 26 21:41:14.073202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 700/1405] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:14.211957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:14.212900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:14.219330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.219767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.220531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:14.220999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:14.250530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e05c62d1-54f8-479b-986a-616c97a4fe94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042413 May 26 21:41:14.251093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 706/1406] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:15.085698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:15.086626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:15.093361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.093819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.094604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.095043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.125224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2782d380-4db2-47e8-a963-051241090fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 May 26 21:41:15.125795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 701/1407] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:15.261605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:15.262691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:15.270005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.270464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.271228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:15.271669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:15.275615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:15.302545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-debe1f68-b752-409f-91e6-b14f0f33a0d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 May 26 21:41:15.303125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 707/1408] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:16.136943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:16.138629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:16.145063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:16.145509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:16.146260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:16.146695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:16.174744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9f4dbfe1-9b16-448e-b3fa-e83f8147d7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041817 May 26 21:41:16.175285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 702/1409] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:16.314307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:16.315342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:16.322662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:16.323199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:16.324043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:16.324564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:16.355653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0fbd437d-ef64-42ed-952a-dd861961ac64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 May 26 21:41:16.356273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 708/1410] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:17.186963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:17.187922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:17.194864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.195321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.196100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.196542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.227672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c8b7539-9b42-4113-97d5-50d01203723a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045082 May 26 21:41:17.228256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 703/1411] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:17.367121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:17.368214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:17.376363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.376866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.377660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:17.378134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:17.410280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4849319-e4e6-4eef-b870-aa8e2a7062fb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 May 26 21:41:17.410872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 709/1412] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:18.240851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:18.241819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:18.244311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=58 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:18.249680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.250130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.255498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.255498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.282663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-21095e72-0db3-4a7c-ab47-7e998efe5a59 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 May 26 21:41:18.283234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 704/1413] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:18.422866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:18.423795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:18.430222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.430666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.431436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:18.431874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:18.463001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-62e7541b-a2ac-481e-a36b-b976b2316916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044319 May 26 21:41:18.463575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 710/1414] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:18.826275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:41:18.826503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:41:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:41:19.294715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:19.295633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:19.302114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.302564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.303324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.303757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.334927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a88d9c4a-d93e-466a-8398-c588c462c9f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 May 26 21:41:19.335502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 705/1415] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:19.475739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:19.476699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:19.483576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.484026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.484857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:19.485299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:19.517860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4532d927-fdda-4527-8b21-0a7df6ca1b83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046370 May 26 21:41:19.523696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 711/1416] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:19.959768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:41:19.959986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:41:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:41:20.346054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:20.346984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:20.353462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.353915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.354681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.355123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.383896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6d2bd78f-5bb2-4786-b88c-6b7c1d079fa1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041841 May 26 21:41:20.384448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 706/1417] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:20.531403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:20.532330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:20.539055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.539650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.540431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:20.540901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:20.587025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-457f28bc-8fba-430a-bf08-2f3b445f0086 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059567 May 26 21:41:20.587617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 712/1418] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:21.395801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:21.396771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:21.403418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.404458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.405270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.405707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.408208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:21.436348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71eb2506-d4f4-467c-81e7-bd0d7b8e88a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 May 26 21:41:21.436958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 707/1419] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:21.598629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:21.599556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:21.606038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.606496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.607268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:21.607709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:21.639005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6ec4eb4e-080b-47b1-9545-2c35f77f9d4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 May 26 21:41:21.639571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 713/1420] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:22.448039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:22.449007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:22.456676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.457128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:22.458045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.458484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:22.489008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ed692d9d-6a86-467a-933e-9271c904c9c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044914 May 26 21:41:22.489396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 708/1421] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:22.649751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:22.650676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:22.657298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.657781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:22.658562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:22.659002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:22.690581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-52ab8534-8212-43b0-a098-fb31f4d51e65 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 May 26 21:41:22.691144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 714/1422] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:23.500831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:23.501791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:23.508424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:23.508909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.509682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:23.510118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.540870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b7a03b1d-7174-4cbf-a2ac-7a5a3d9e2cf2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 May 26 21:41:23.541448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 709/1423] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:23.702827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:23.703688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:23.710167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:23.710617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.711429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:23.711974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:23.742594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4e145192-2a72-4a07-bbd8-36904a82e44e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 May 26 21:41:23.743177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 715/1424] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:24.553859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:24.554783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:24.562517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.562980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.563756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.564198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.593902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f5d97054-749f-4591-bd34-7fbdc7785408 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044446 May 26 21:41:24.594460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 710/1425] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:24.754177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:24.755101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:24.761342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.761800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.762591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:24.763294 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:24.794676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66f03686-30db-4f07-b981-17922eca1b4e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 May 26 21:41:24.795439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 716/1426] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:25.607008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:25.608138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:25.614799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.615294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.616011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.616435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.648343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a06dea55-fa6a-46ae-81f8-ac9d526000fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046451 May 26 21:41:25.648948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 711/1427] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:25.805857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:25.806806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:25.813730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.814093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.814907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:25.815342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:25.853203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a6873ba6-dd0a-4e34-a682-a1042e6d9ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045566 May 26 21:41:25.853203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 717/1428] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:26.660736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:26.661705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:26.667852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:26.668302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:26.669103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:26.669536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:26.699344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-126ec20c-0fb0-479d-bcb0-0042c9e07112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043174 May 26 21:41:26.699913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 712/1429] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:26.858978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:26.859927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:26.866816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:26.867272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:26.868048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:26.868491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:26.899574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-517030ad-6730-4605-aeb8-0cb39a853cf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044594 May 26 21:41:26.900466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 718/1430] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:27.710877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:27.711803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:27.718135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.719678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:27.719678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.720065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:27.749545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-15a1c722-26e9-4fd0-8bb4-01d2821f8d74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 May 26 21:41:27.750106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 713/1431] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:27.911409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:27.912336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:27.918890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.919340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:27.920113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:27.920558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:27.950882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-59e4189c-8f7c-4bb9-b089-025a506564db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043888 May 26 21:41:27.951452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 719/1432] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:28.761881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:28.763065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:28.770133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:28.770583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:28.771353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:28.771794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:28.801047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-172789c8-e7ff-48df-a2a4-3f021813a140 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 May 26 21:41:28.801608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 714/1433] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:28.963287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:28.964213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:28.970861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:28.971322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:28.972094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:28.972539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:29.002458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a03cf0a4-1f95-4eee-83f8-cf6dc648c5a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 May 26 21:41:29.003559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 720/1434] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:29.812772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:29.813631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:29.820072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:29.820524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:29.821318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:29.821760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:29.850446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fa64a52b-f3b2-4755-a2c8-447ce13c330b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041703 May 26 21:41:29.850999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 715/1435] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:30.014855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:30.015768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:30.022294 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:30.022738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:30.023491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:30.023914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:30.054063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-563dc253-83a4-47ae-9b8c-f00f12cedfee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043366 May 26 21:41:30.054662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 721/1436] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:30.861945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:30.863275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:30.870026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:30.870482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:30.871258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:30.871731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:30.900770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aa494a86-4044-4ce9-a1e7-7b4b17ce2cf8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042826 May 26 21:41:30.901322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 716/1437] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:31.066209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:31.067122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:31.073518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:31.073962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:31.074718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:31.075147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:31.104622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3dcdce57-5a5e-48b7-a741-55376854555b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 May 26 21:41:31.105207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 722/1438] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:31.912506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:31.913371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:31.919803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:31.920251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:31.921050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:31.921490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:31.951819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-76f656eb-222e-47dd-9eff-9a6c7fcaff66 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043340 May 26 21:41:31.952365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 717/1439] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:32.117024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:32.118092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:32.125443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:32.126584 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:32.127582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:32.128106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:32.155783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:32.160906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc7f86ea-04cf-4656-ac45-192a1ed89d8e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048938 May 26 21:41:32.161485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 723/1440] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:32.766937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:41:32.767215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:41:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:41:32.965623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:32.966862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:32.975171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:32.975624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:32.976526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:32.977141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:33.020209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d98b5a4-4448-4ba0-8e82-b4da5c528328 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060323 May 26 21:41:33.020873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 718/1441] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:33.177989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:33.179196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:33.186939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:33.187604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:33.188765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:33.189425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:33.226513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d93e3f4e-c65b-4de0-b82a-8fc08bc8626a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056222 May 26 21:41:33.227391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 724/1442] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:34.031569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:34.032522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:34.039840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:34.040293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:34.041097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:34.041536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:34.088795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b957f97e-6f62-4e5a-ae71-b5e94da8723e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061133 May 26 21:41:34.089361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 719/1443] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:34.240000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:34.241047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:34.248149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:34.248624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:34.249407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:34.249851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:34.283557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2110e5cc-903b-4026-a2d5-66c7bfe7bb5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048480 May 26 21:41:34.283892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 725/1444] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:35.101910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:35.102838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:35.109576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:35.110026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:35.110794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:35.111259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:35.143056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e7cfc6d3-26eb-4f21-9e70-341cefd1bfe6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045166 May 26 21:41:35.143666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 720/1445] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:41:35.297218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:35.298012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:35.306929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:35.307389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:35.308165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:35.308613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:35.342944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0116a6d1-781d-4458-9dbc-584f091641ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050254 May 26 21:41:35.343991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 726/1446] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:36.161688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:36.162633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:36.169406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:36.169861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:36.170637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:36.171073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:36.202302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f730d13a-4dfe-476c-b762-ed74bbed283b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049798 May 26 21:41:36.202878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 721/1447] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:36.356475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:36.357450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:36.367257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:36.368026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:36.369395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:36.370152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:36.417579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-76fb8aea-49e9-4b3e-90da-0a19cf811194 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065226 May 26 21:41:36.418325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 727/1448] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:37.213400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:37.214467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:37.221175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:37.221624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:37.222405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:37.222846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:37.254468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-28100acb-1f79-4711-afc3-2562d5c8543a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045045 May 26 21:41:37.255092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 722/1449] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:37.430895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:37.431827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:37.441445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:37.441995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:37.443034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:37.443637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:37.485036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8614fa9e-35bb-4005-a183-05c53adccb4c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057942 May 26 21:41:37.485804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 728/1450] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:38.266669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:38.267587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:38.274049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:38.274493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:38.275248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:38.275680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:38.301793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:38.308039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6698332d-157d-495a-b6a8-31c8be4fdec3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045541 May 26 21:41:38.308678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 723/1451] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:38.549855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:38.549855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:38.549855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:38.549855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:38.550711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:38.550711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:38.550711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aaedcd07-bf5e-4b62-9239-e2f1c4a9b046 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045713 May 26 21:41:38.550711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 729/1452] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:39.320019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:39.320968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:39.327745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:39.328203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:39.329013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:39.329448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:39.361714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae8dafb0-e8af-424f-81d5-d55c83d24939 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 May 26 21:41:39.362308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 724/1453] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:39.574951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:39.577014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:39.583516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:39.589427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:39.590018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:39.591025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:39.591567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:39.623697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-258d77a5-47a8-425e-82a8-cbb81bc8b436 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058817 May 26 21:41:39.624287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 730/1454] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:40.374029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:40.375050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:40.382148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.382591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.383385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.383850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.417116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da8c6c13-2e1e-468a-98f5-cd8e9d5da38d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 May 26 21:41:40.417700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 725/1455] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:40.637861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:40.639423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:40.652358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.653208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.654644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:40.655472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:40.713835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-753241ae-00aa-4f7d-aab3-931f82f9261b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080178 May 26 21:41:40.714772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 731/1456] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:41.429847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:41.430981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:41.438112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.440095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.440095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.440095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.472148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-23ec0f7c-8b66-4022-a156-7c10f4b5d992 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046458 May 26 21:41:41.473294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 726/1457] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:41.727503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:41.728630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:41.735504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.736020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.736752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:41.737183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:41.774859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3da01de7-c467-40f6-98a6-bd9adc490bd6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051265 May 26 21:41:41.775742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 732/1458] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:42.485080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:42.486084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:42.493204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.493715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.494548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.495005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.529798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0f6d232c-3b58-44bb-835e-d45b1f12e03c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049006 May 26 21:41:42.530389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 727/1459] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:42.790536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:42.791779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:42.799234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.799757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.801389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:42.802052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:42.838092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7ee24233-3d04-4c36-a86d-405775819541 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054043 May 26 21:41:42.838676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 733/1460] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:43.545393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:43.546906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:43.558222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.558915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:43.560164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.560867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:43.603258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0b3da58d-7262-4822-ba38-c28a57107c4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064894 May 26 21:41:43.603840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 728/1461] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:43.851347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:43.852364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:43.859869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.860378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:43.861288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:43.861799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:43.903687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dc55d122-696b-4865-be23-a707e519cf8f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057045 May 26 21:41:43.904393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 734/1462] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:44.615203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:44.616205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:44.623231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:44.623719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:44.624519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:44.625020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:44.654947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d46b0f76-e4c3-42e5-9eca-57fef5b5539c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 May 26 21:41:44.655492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 729/1463] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:44.915902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:44.916782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:44.923537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:44.923980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:44.924784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:44.925219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:44.975934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-363f09e3-5a27-4c27-98d0-c7e7c6655562 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064078 May 26 21:41:44.976958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 735/1464] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:45.666830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:45.667809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:45.674805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:45.675262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:45.676080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:45.676523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:45.709186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae90e62e-c3b2-41e7-ab0d-198eef24dacb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046205 May 26 21:41:45.709798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 730/1465] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:45.992210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:45.993193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:46.000093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.000544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.001371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.001815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.038774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9c75d300-66b5-4700-8c06-9b97e82449fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051062 May 26 21:41:46.039376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 736/1466] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:46.720629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:46.721588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:46.728912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.729376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.730170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:46.730607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:46.762048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-40e38ba4-925d-4b86-9dec-164f3f99d5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045350 May 26 21:41:46.762892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 731/1467] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:47.050673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:47.052262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:47.059184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.059633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.060410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.060892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.090955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c18b40ff-fd9a-48f6-ac39-4ef1168c1383 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 May 26 21:41:47.091534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 737/1468] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:47.774285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:47.775209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:47.782482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.783091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.784095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:47.784782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:47.821940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f4568391-722d-4610-9be7-c20a3253fba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051421 May 26 21:41:47.822772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 732/1469] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:48.103450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:48.104264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:48.111090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.111530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.112288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.112761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.142344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5eab9985-ddab-40ce-a7f7-f13c2d0e46f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042814 May 26 21:41:48.142913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 738/1470] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:48.834910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:48.835832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:48.838144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=58 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:48.842843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.843293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.844050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:48.844505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:48.873096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7bdce605-98f8-4d64-aa6b-31b6c931e8f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042598 May 26 21:41:48.873644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 733/1471] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:49.154812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:49.155562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:49.162886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.163339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.164121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.164567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.195439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fc22eb12-9202-46f0-9d04-34f16056b476 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044727 May 26 21:41:49.196002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 739/1472] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:49.885626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:49.886603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:49.894281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.894281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.895730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:49.896172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:49.926055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-31d54dab-56d8-4f6f-a0ad-c6a05ab435ed tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 May 26 21:41:49.926674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 734/1473] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:50.207276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:50.208770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:50.215333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:50.215790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:50.216569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:50.217039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:50.233503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:50.245984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-54f40442-f925-41fe-b243-4124995a4e11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042732 May 26 21:41:50.246550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 740/1474] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:50.938063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:50.939089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:50.946211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:50.946669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:50.947446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:50.948010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:50.978246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e37cc1a5-6f5a-4a8b-bbbf-ce7421b3be3c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 May 26 21:41:50.978820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 735/1475] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:51.257710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:51.259850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:51.265677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.266234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:51.267006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.267449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:51.296844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0a989a1e-5b42-4ba0-b31b-1b3908b80d9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 May 26 21:41:51.297399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 741/1476] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:51.990046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:51.990974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:51.997558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.998014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:51.998794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:51.999237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:52.029658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c1857f0a-48b3-4d9e-b821-d98f6d422a1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 May 26 21:41:52.030227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 736/1477] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:52.309007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:52.309688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:52.316385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:52.317381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:52.318174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:52.318618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:52.348938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-437f2e82-36de-4833-b132-73bab4822bf0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044155 May 26 21:41:52.349503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 742/1478] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:53.041899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:53.042816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:53.049471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.049922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.050688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.051816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.081250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d5a52555-bc88-411f-a473-01e0f970b28a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043151 May 26 21:41:53.081835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 737/1479] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:53.360543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:53.361467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:53.368606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.369170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.369970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:53.370414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:53.404365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-503e78e5-8fac-417d-a0d6-95f95bf2516c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047865 May 26 21:41:53.404987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 743/1480] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:54.093196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:54.094113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:54.101934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.102386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.103156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.103598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.132082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9453bb2b-0c53-42de-af0a-d8005f000352 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042897 May 26 21:41:54.132651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 738/1481] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:54.416733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:54.417733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:54.425300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.425805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.426620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:54.427087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:54.458795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a1796362-a699-45af-ab1a-626ead5ae610 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 May 26 21:41:54.459364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 744/1482] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:55.143673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:55.144607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:55.150960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.165777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.165777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.165777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.182921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4f454096-747a-45d6-8e3f-44804b3301a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 May 26 21:41:55.183493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 739/1483] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:55.470861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:55.471737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:55.478771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.479211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.479978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:55.480422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:55.510912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61fccea0-8180-42dc-8537-f3891c6bb800 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 May 26 21:41:55.511547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 745/1484] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:56.194538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:56.195634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:56.202483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.202967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:56.203737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.204175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:56.217574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:41:56.232984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea4b3966-a305-49da-a7ae-ab9b8062b9a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042379 May 26 21:41:56.239108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 740/1485] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:56.523766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:56.524718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:56.531381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.531836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:56.532622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:56.533070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:56.562485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-594e8a75-7463-4a41-aecb-a73c95a70875 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 May 26 21:41:56.563047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 746/1486] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:57.249227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:57.250158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:57.257132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.257588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.258372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.258818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.290336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c1d61cd-3cfa-4516-8835-294fba209ea4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 May 26 21:41:57.290908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 741/1487] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:57.574518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:57.575457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:57.583022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.583477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.584264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:57.584962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:57.615705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7c1b2304-11eb-4ca7-a9c6-b29b0b9f2f38 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 May 26 21:41:57.616293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 747/1488] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:58.302398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:58.303318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:58.309783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.310231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.310986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.311420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.340841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a30a995e-5e49-4600-ae09-a4044d179df4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042365 May 26 21:41:58.341391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 742/1489] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:58.627462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:58.628375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:58.636358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.636831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.637869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:58.638299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:58.667606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-94af1017-2814-4a9f-a84c-6aeb828bdc50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 May 26 21:41:58.668175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 748/1490] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:59.353243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:59.354201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:59.360600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.361064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.364894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.364894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.391344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ca44dc1-ff75-4620-ba4f-a19075d0ff90 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041982 May 26 21:41:59.391907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 743/1491] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:41:59.679958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:41:59.680967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:41:59.687461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.687916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.688726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:41:59.689168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:41:59.722634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f4ade14-9bb4-42ed-a300-fcf4e5b75811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047241 May 26 21:41:59.723216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 749/1492] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:41:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:00.403668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:00.404656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:00.411112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:00.411567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:00.412338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:00.412814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:00.442034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e6f3dc2-5e95-4e56-a921-fbf8a43cfdd6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041806 May 26 21:42:00.442591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 744/1493] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:00.734507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:00.735349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:00.741954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:00.742405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:00.743169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:00.743608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:00.773455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4ac3b839-027d-4640-a5c5-33e16cd3cb3f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042738 May 26 21:42:00.774012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 750/1494] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:01.453598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:01.454445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:01.461713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:01.462166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:01.463020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:01.463463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:01.492573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6a44bf20-ea3f-4430-a4bb-4e4127f2cb7c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 May 26 21:42:01.493160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 745/1495] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:01.784088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:01.785079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:01.791482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:01.791924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:01.792708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:01.793143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:01.822257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0ba5ec28-afac-4e11-bc98-e2739187bfbe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042093 May 26 21:42:01.822792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 751/1496] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:02.503554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:02.505131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:02.511643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:02.512386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:02.513186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:02.514242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:02.542689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-58e5593e-d440-49d6-ada3-66339c2389c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 May 26 21:42:02.543250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 746/1497] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:02.833965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:02.834808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:02.841357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:02.841812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:02.842580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:02.843025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:02.872456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ff87a092-7e19-445e-a35a-4a83e052b9aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 May 26 21:42:02.873048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 752/1498] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:03.556542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:03.557495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:03.563553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:03.564007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:03.564831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:03.565271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:03.593902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-05895c50-9be0-41a2-b7a7-15cafe5c82ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 May 26 21:42:03.594459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 747/1499] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:03.884566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:03.885440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:03.892286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:03.892773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:03.893528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:03.893960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:03.923670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c51ed06d-d177-41ef-be6f-3f3eb740dbee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043074 May 26 21:42:03.924221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 753/1500] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:04.605545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:04.606465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:04.612936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:04.613383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:04.614721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:04.615158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:04.644104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f60158e8-e096-465a-9069-07d6cc858715 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042523 May 26 21:42:04.644688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 748/1501] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:04.935228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:04.936094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:04.942729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:04.943174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:04.943934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:04.944369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:04.972297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-83ef68ec-61f1-414c-8ce2-8582efd20923 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041142 May 26 21:42:04.972887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 754/1502] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:05.654961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:05.655885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:05.662536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:05.662991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:05.663758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:05.664199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:05.693611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf34af60-30ca-4604-8c1b-77d07ead9bf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042565 May 26 21:42:05.694170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 749/1503] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:05.984608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:05.985467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:05.992528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:05.993010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:05.993783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:05.994223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:06.024266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-debdc920-b6b3-4d9c-9c52-2e333665a686 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 May 26 21:42:06.024857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 755/1504] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:06.705581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:06.706507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:06.713113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:06.713567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:06.714329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:06.714773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:06.744147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1baafb80-e890-4e7f-864a-5bf8d61b285d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042458 May 26 21:42:06.744728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 750/1505] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:07.036658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:07.037597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:07.044147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:07.044608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:07.045378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:07.045818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:07.075246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cdc1e660-d9c9-4412-a55e-7b703ee4d182 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043186 May 26 21:42:07.075799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 756/1506] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:07.756214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:07.757191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:07.764353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:07.764836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:07.765617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:07.766058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:07.796112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d658022a-cd22-44cb-b097-61c7c10dd7d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 May 26 21:42:07.796702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 751/1507] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:08.087315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:08.088227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:08.095077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:08.095526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:08.096295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:08.096763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:08.101220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:08.127240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2c70eb87-c4bb-470a-a458-8065f8a5d41a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043922 May 26 21:42:08.127798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 757/1508] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:08.807666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:08.808669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:08.815543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:08.815964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:08.817289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:08.817732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:08.848781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-df2088a3-e2ea-42d0-994d-29ef2ab4931c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 May 26 21:42:08.849358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 752/1509] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:09.139677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:09.140638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:09.147861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:09.148311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:09.149095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:09.149531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:09.179418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-94ad725c-5017-4d05-8da2-4297612bc1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044254 May 26 21:42:09.179978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 758/1510] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:09.860402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:09.861344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:09.868706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:09.869158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:09.869915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:09.870352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:09.899605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-def56aa9-d2c0-4db1-b086-4ed90c819ff0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 May 26 21:42:09.900162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 753/1511] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:10.190669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:10.191497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:10.198070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:10.198520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:10.199281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:10.199716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:10.231385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-001205c2-6c4d-44eb-b031-190e8e2b8aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044731 May 26 21:42:10.232349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 759/1512] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:10.911802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:10.912784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:10.919256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:10.919710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:10.920800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:10.921250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:10.950579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0df085a-2470-4c1d-bf14-69f4b17e435d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 May 26 21:42:10.951061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 754/1513] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:11.243481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:11.244409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:11.246779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:11.251893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:11.252345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:11.253181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:11.253624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:11.287353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-00715caf-943f-4872-8ec2-3c530c8ddddd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048467 May 26 21:42:11.287923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 760/1514] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:11.962548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:11.963420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:11.970165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:11.970615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:11.971377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:11.971814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:12.010878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e7c6900c-f5c2-441e-a862-f832359cd933 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052254 May 26 21:42:12.011329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 755/1515] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:12.298154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:12.299069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:12.305809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:12.306410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:12.307179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:12.307625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:12.337050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ab939d04-aa13-45c2-b810-7eb8aef1e59e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 May 26 21:42:12.337623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 761/1516] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:13.022826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:13.023777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:13.030503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:13.030956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:13.031722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:13.032160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:13.061806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c5f02f36-12d2-40d7-ad3d-9916bfe68842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 May 26 21:42:13.062372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 756/1517] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:13.348736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:13.349610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:13.356120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:13.356571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:13.357361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:13.357800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:13.387061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cea430fe-4217-41e6-9b54-06e5c0294abb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 May 26 21:42:13.387614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 762/1518] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:14.073539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:14.074458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:14.080890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:14.081329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:14.082076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:14.082504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:14.084808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:14.111412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-00408394-9a85-4ee8-b3fb-16ff7e0b6e38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041791 May 26 21:42:14.111956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 757/1519] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:14.399388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:14.400231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:14.406757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:14.407202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:14.407963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:14.408406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:14.437494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e438dba5-accb-4d11-a55e-544f7d271158 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042661 May 26 21:42:14.438042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 763/1520] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:15.124003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:15.124948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:15.131486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:15.131934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:15.132731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:15.133173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:15.162871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e8aa2673-e7b3-49e4-afca-8d4b2fc14d0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043139 May 26 21:42:15.163429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 758/1521] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:15.449642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:15.450586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:15.457662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:15.458117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:15.458879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:15.459307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:15.488023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-538b0365-bd0a-4d04-90fd-5059448708da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042715 May 26 21:42:15.488556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 764/1522] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:16.173945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:16.174872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:16.182069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:16.182519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:16.183282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:16.183722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:16.211795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-655280c7-42e2-4aaa-9d49-6e87eaaead9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 May 26 21:42:16.212350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 759/1523] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:16.499549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:16.500463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:16.506938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:16.507379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:16.508130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:16.508560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:16.537914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4d665c02-e9a8-4dde-aa6f-b39dcb4c54d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042288 May 26 21:42:16.538466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 765/1524] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:17.222906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:17.223815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:17.230550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:17.230991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:17.231741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:17.232171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:17.262940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d7b394fb-8cd6-4870-b8d9-9007b1b44c2f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 May 26 21:42:17.263642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 760/1525] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:17.549655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:17.550699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:17.557978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:17.558430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:17.559793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:17.559793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:17.590489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-92bf8079-9f55-45e9-9f6e-3ddda91f5280 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044714 May 26 21:42:17.591088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 766/1526] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:18.273861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:18.274818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:18.281386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:18.281843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:18.282613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:18.283053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:18.312414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4411663e-2ebf-49c0-99a1-ab2bb2460d76 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042456 May 26 21:42:18.313007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 761/1527] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:18.602503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:18.603427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:18.609954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:18.610408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:18.611184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:18.611629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:18.641047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed74f0d3-1d40-4f4a-bbb4-06d15dfe8388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043054 May 26 21:42:18.641605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 767/1528] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:19.323972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:19.324922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:19.331504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:19.332035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:19.333544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:19.334060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:19.362939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f0e62db4-7cf9-49b6-b569-b52cec3ff540 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 May 26 21:42:19.363554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 762/1529] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:19.652881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:19.653806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:19.660471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:19.660971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:19.661735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:19.662180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:19.694155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5722a8b-1efa-44cd-9052-f9ce7807e0d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 May 26 21:42:19.694725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 768/1530] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:20.375130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:20.376343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:20.378732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:20.383700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:20.384155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:20.384963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:20.385463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:20.418381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61a04591-ab04-45f5-bad2-ba24c71fec50 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047710 May 26 21:42:20.418946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 763/1531] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:20.705667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:20.706523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:20.714170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:20.714627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:20.715420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:20.715863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:20.747323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3c33e7b3-b01e-4d6d-a835-000eb1d899db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045693 May 26 21:42:20.747915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 769/1532] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:21.431215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:21.432176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:21.438675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:21.439123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:21.439884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:21.440329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:21.468985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e63413c3-e01a-4cdb-946b-a48db4896dec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042842 May 26 21:42:21.469545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 764/1533] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:21.759024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:21.759936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:21.766614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:21.767055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:21.767807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:21.768284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:21.797859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-41c577d8-ea87-418d-b490-875122c8538a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042770 May 26 21:42:21.798417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 770/1534] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:22.480965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:22.481811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:22.488537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:22.489028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:22.489795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:22.490242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:22.520117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6ab0760c-631f-4c53-a273-6416f523d940 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043194 May 26 21:42:22.520687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 765/1535] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:22.809620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:22.810563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:22.817053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:22.817495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:22.818246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:22.818676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:22.847611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cea582b3-aac1-4e9c-8d4b-bf711c23fbe3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041889 May 26 21:42:22.848159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 771/1536] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:23.531501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:23.532404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:23.539314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:23.539760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:23.540515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:23.540966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:23.570205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cb277736-6322-4dbb-ac87-fa22d8113e6e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 May 26 21:42:23.570764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 766/1537] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:23.859593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:23.860524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:23.867509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:23.867963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:23.868782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:23.869252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:23.899000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0c7ed620-1e48-447e-b9a6-daed59644ece tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043502 May 26 21:42:23.899553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 772/1538] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:24.582093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:24.583010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:24.589760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:24.590209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:24.591067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:24.591503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:24.621447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-52e4d2e5-a434-47a2-9052-d12479e15f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 May 26 21:42:24.622030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 767/1539] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:24.910868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:24.911696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:24.918687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:24.919132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:24.919898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:24.920328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:24.946240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:24.950651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c64bd733-de10-472f-bbe1-ac0cae97f8cc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043914 May 26 21:42:24.951210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 773/1540] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:25.633011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:25.633927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:25.640980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:25.641370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:25.642138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:25.642569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:25.672631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-41d96c53-5520-48b8-a8d0-768f8fcde66c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044036 May 26 21:42:25.673235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 768/1541] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:25.962789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:25.963621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:25.970153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:25.970592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:25.971356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:25.971788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:26.000435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f5f91e4f-7e3b-4cfc-beaf-e60a382ca992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042050 May 26 21:42:26.001009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 774/1542] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:26.685120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:26.686034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:26.692455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:26.692936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:26.693696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:26.694137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:26.723302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a16f3e47-41e0-4a00-89f3-bf9112263b29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042181 May 26 21:42:26.723861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 769/1543] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:27.012996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:27.013920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:27.020448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:27.020917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:27.021692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:27.022133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:27.051282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-921a2a22-1dd8-4a03-8df5-13fa1877323b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 May 26 21:42:27.051900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 775/1544] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:27.735233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:27.736162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:27.743225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:27.744228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:27.744632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:27.745076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:27.773414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b313f97-037a-42a8-a69a-6effb47e3458 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042024 May 26 21:42:27.773965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 770/1545] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:28.063032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:28.063945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:28.070484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:28.070928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:28.071682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:28.072113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:28.101900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0b85c120-5fdf-4573-bc09-3ce1056b5e55 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 May 26 21:42:28.102453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 776/1546] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:28.785164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:28.786082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:28.793067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:28.793512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:28.794268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:28.794698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:28.823606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0cd049f7-57f0-4db1-a3fd-3283b3d80fb7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042303 May 26 21:42:28.824132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 771/1547] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:29.113837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:29.114690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:29.121218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:29.121675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:29.122444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:29.122887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:29.152192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-898ab3ff-25d1-49f8-9207-74e6b59c3ccd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 May 26 21:42:29.152768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 777/1548] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:29.835765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:29.836768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:29.843147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:29.843602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:29.844359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:29.844826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:29.873929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-588bdc2c-172f-48e7-a756-edf2f952d3dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042662 May 26 21:42:29.874478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 772/1549] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:30.164410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:30.165363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:30.171913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:30.172364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:30.173161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:30.173610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:30.202861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f034d5e-0510-4a6a-88ad-67b8b20b55da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 May 26 21:42:30.203410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 778/1550] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:30.886304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:30.887338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:30.893842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:30.894297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:30.895062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:30.895502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:30.920171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:30.924644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b049c881-37a5-42b0-94ea-fb57c4007750 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042545 May 26 21:42:30.925204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 773/1551] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:31.215190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:31.216150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:31.223094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:31.223544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:31.224315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:31.224795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:31.254519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7a79e313-90d3-4e71-a7a9-56c0ac0eb073 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 May 26 21:42:31.255088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 779/1552] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:31.936306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:31.937279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:31.944194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:31.945308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:31.946063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:31.946495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:31.975227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5e22c388-19cc-4645-a3cc-6973d6d9e706 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 May 26 21:42:31.975795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 774/1553] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:32.266511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:32.267457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:32.274030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:32.274482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:32.275255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:32.275696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:32.306626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-34af320a-bb4e-4e35-9374-ff8e8fcc9145 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 May 26 21:42:32.307194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 780/1554] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:32.994033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:32.994033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:32.994916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:32.995365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:32.996125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:32.996561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:33.025535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-adb3256e-0783-499a-a999-b140baa6e0f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 May 26 21:42:33.026087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 775/1555] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:33.318448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:33.319298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:33.325951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:33.326405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:33.327171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:33.327614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:33.357950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-98d2c5e0-99e2-4a73-bde3-50cdef12d1a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043642 May 26 21:42:33.358510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 781/1556] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:34.037431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:34.038353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:34.044856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:34.045303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:34.046071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:34.046507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:34.076011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2970d3ce-feff-4664-89be-96bed2563ab3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042538 May 26 21:42:34.076567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 776/1557] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:34.370188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:34.371028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:34.377684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:34.378144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:34.378954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:34.379357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:34.409280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f5623d9b-a842-4d91-9cce-38aea4fc0028 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 May 26 21:42:34.409844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 782/1558] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:35.087812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:35.088764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:35.095211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:35.095657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:35.096414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:35.096877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:35.125722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bc85c249-b29a-4c3e-9d5b-607ea19ba564 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042396 May 26 21:42:35.126284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 777/1559] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:35.421238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:35.422075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:35.428562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:35.429072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:35.429843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:35.430313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:35.459095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e530a84a-20c2-4cf0-879e-a363e39d469e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 May 26 21:42:35.459645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 783/1560] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:36.138166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:36.139090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:36.145460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:36.145913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:36.146678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:36.147115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:36.176464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71aefcda-6c1a-4087-88a5-260f0b08f2b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043063 May 26 21:42:36.177046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 778/1561] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:36.471558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:36.472450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:36.479840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:36.480298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:36.481110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:36.481550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:36.515482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1ae19b9-141d-465c-89ca-3b97fb21c537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048003 May 26 21:42:36.516050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 784/1562] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:37.188317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:37.189247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:37.195630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:37.196077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:37.196883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:37.197322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:37.228398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e48c0fc7-fd2e-48d3-93f3-42a03ace3ff1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043985 May 26 21:42:37.228881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 779/1563] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:37.527422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:37.528343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:37.534926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:37.535380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:37.536147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:37.536608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:37.566436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1e248175-6d89-4fd5-926b-ac0c1534b0bd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043561 May 26 21:42:37.567018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 785/1564] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:38.239751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:38.240696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:38.248052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:38.248498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:38.249298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:38.249732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:38.279665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-692e31de-68d7-4c1a-866f-1a005b714055 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 May 26 21:42:38.280228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 780/1565] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:38.578069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:38.578990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:38.585536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:38.585990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:38.587276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:38.587712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:38.616919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-99d43832-a8bd-49a8-a5cb-ea17cbedba9a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 May 26 21:42:38.617478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 786/1566] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:39.291473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:39.292411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:39.298883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:39.299338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:39.300107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:39.300551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:39.329473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e7bdbfd3-6a9a-4cc1-b95e-146e53b09ba1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042046 May 26 21:42:39.330025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 781/1567] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:39.628683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:39.629594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:39.637044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:39.641715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:39.641715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:39.641715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:39.667883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1449107e-e6c3-46f3-938f-d9546d279925 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 May 26 21:42:39.668446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 787/1568] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:40.341064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:40.341983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:40.348468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:40.348993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:40.349883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:40.350320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:40.379858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5b05c9e8-5b4d-4cf3-9d35-3465ed3b6186 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 May 26 21:42:40.380414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 782/1569] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:40.679700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:40.680650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:40.686968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:40.687469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:40.688258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:40.688722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:40.718468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1003eb9b-41d9-475c-8866-6b422d56ac8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042898 May 26 21:42:40.719016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 788/1570] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:41.392346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:41.393320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:41.400177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:41.400661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:41.401445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:41.401885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:41.434754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fa4d8524-54a3-4ac2-9f91-b254ff284a47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046653 May 26 21:42:41.437585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 783/1571] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:41.730530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:41.731451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:41.738079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:41.738531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:41.739299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:41.739741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:41.768640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-983ca8de-785d-46fc-a81c-15ffc57697ba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042788 May 26 21:42:41.769194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 789/1572] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:42.446850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:42.448287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:42.454807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:42.455255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:42.456015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:42.456451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:42.485024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c99a150c-cc57-4a2d-9eb6-ff4077c6cb07 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042270 May 26 21:42:42.485615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 784/1573] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:42.780862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:42.781804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:42.784106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:42.788933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:42.789383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:42.790153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:42.790592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:42.807346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:42.820972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a7191413-24f2-4aef-bc84-f597c36b3636 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 May 26 21:42:42.821972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 790/1574] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:43.497477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:43.498407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:43.504993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:43.505441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:43.506208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:43.506646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:43.535656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-543d00ec-1876-46e4-8e1f-94ba7ae15620 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042702 May 26 21:42:43.536209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 785/1575] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:43.833515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:43.834503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:43.841917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:43.842365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:43.843136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:43.843577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:43.873469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9d8f6aa6-ee23-439e-8656-a93df70c9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044404 May 26 21:42:43.874002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 791/1576] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:44.547522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:44.548442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:44.554905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:44.555359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:44.556666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:44.557105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:44.586420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78356c6b-8579-4578-96b6-c0d51bd9e327 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042810 May 26 21:42:44.586976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 786/1577] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:44.886026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:44.886896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:44.893318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:44.893760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:44.894515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:44.894940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:44.923542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-533fccb1-341a-4244-aced-5c1be7526b56 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 May 26 21:42:44.924089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 792/1578] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:45.597034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:45.597980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:45.604918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:45.605363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:45.606109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:45.606542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:45.634867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-86da087b-bd3d-4b5d-ab53-287f5ef805a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041789 May 26 21:42:45.635413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 787/1579] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:45.935425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:45.936269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:45.942747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:45.943201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:45.943967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:45.944412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:45.973762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6792bedb-1f84-414c-93b2-74ada9783448 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042397 May 26 21:42:45.974315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 793/1580] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:46.646623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:46.647571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:46.654024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:46.654466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:46.655217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:46.655648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:46.685215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-69de1d3e-0ddd-4cb1-91c3-5aecd23bd5d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042429 May 26 21:42:46.685769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 788/1581] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:46.986189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:46.987117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:46.993711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:46.994172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:46.994940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:46.995383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:47.025144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9bdb9606-5714-43b3-9cd9-c375c65bdaf8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042466 May 26 21:42:47.025705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 794/1582] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:47.697556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:47.698483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:47.705029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:47.705479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:47.706249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:47.706691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:47.736844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cb2b57e5-7515-4690-81f4-f87b344d03d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 May 26 21:42:47.737407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 789/1583] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:48.037285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:48.038204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:48.045348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:48.045797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:48.046562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:48.046999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:48.076730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-91af5810-0023-4b3a-8a56-644494c0cca4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043389 May 26 21:42:48.077283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 795/1584] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:48.748396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:48.749357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:48.755784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:48.756224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:48.757015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:48.757443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:48.771348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:48.787224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-55155983-abc2-468a-bc5a-8b13a1a591ec tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042766 May 26 21:42:48.787772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 790/1585] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:49.088351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:49.089212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:49.095443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:49.095895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:49.096723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:49.097163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:49.125709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f8b74191-c103-49a5-a02e-ad01a62dfda1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041387 May 26 21:42:49.126254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 796/1586] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:49.798157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:49.799078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:49.806426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:49.806875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:49.807636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:49.808077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:49.837514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2c8d8f9-43cf-4cbe-85aa-d1cf3c448533 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 May 26 21:42:49.838084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 791/1587] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:50.137326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:50.138158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:50.144598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:50.145101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:50.145860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:50.146289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:50.174556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c42587ee-94e3-49a9-8a42-ddf3eec39e86 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 May 26 21:42:50.175098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 797/1588] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:50.848531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:50.849471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:50.856515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:50.856985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:50.857734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:50.858166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:50.887414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc6a9481-3c3a-410a-9f49-ad22452b44a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 May 26 21:42:50.887964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 792/1589] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:51.186425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:51.187359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:51.194001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:51.194458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:51.195233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:51.195755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:51.226134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fbcab8a8-9647-4bb0-8f2e-37bbf8759eb5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 May 26 21:42:51.226721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 798/1590] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:51.898306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:51.899136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:51.901425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:42:51.906164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:51.906614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:51.907377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:51.907816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:51.937225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-610713ce-c58b-441c-a555-c87964c8ed2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 May 26 21:42:51.937773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 793/1591] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:52.237146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:52.238100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:52.244546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:52.245039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:52.245837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:52.246278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:52.275151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-21e8cdee-d214-4ead-9054-0a2728554f78 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041951 May 26 21:42:52.275738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 799/1592] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:52.949498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:52.950362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:52.957007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:52.957457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:52.958212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:52.958639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:52.987212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db1ca7fa-3743-457a-a167-7a9605ced907 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041731 May 26 21:42:52.987762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 794/1593] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:53.287040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:53.288054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:53.295243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:53.295697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:53.296603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:53.296960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:53.326437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fa569da7-5080-42c5-b6ea-47cb68cf9af8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043375 May 26 21:42:53.326994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 800/1594] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:53.999576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:54.000490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:54.006958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:54.007401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:54.008154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:54.008597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:54.036931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-555ba555-5d37-42c6-9b2c-6f85667091c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041256 May 26 21:42:54.037481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 795/1595] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:54.338665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:54.339644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:54.346171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:54.346625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:54.347410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:54.347833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:54.376669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1f849f48-08c4-448a-ae21-62e763b8f601 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042467 May 26 21:42:54.377225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 801/1596] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:55.049171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:55.050085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:55.057032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.057476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.058226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.058653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.087453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5a284047-970d-4774-b001-9679e7234fcc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041873 May 26 21:42:55.087919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 796/1597] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:55.389404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:55.390267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:55.396948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.397400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.398209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:55.398720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:55.430558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-54e22370-7da7-4fb0-b39c-04223486a537 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 May 26 21:42:55.431135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 802/1598] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:42:56.099341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:56.100354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:56.107553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:56.108059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:56.108877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:56.109321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:56.139952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b6cc1fc-54d8-4ed9-8a1a-5439ef30b39b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044564 May 26 21:42:56.140516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 797/1599] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:56.442378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:56.443253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:56.450355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:56.450812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:56.451613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:56.452061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:56.482951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1624f27c-4797-4139-a629-7f08d2113423 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044610 May 26 21:42:56.483545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 803/1600] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:57.152054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:57.152950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:57.159447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.159899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.160714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.161164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.193037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-19e8f961-08e9-44df-b689-fd9ffbddb867 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045322 May 26 21:42:57.193776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 798/1601] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:57.494835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:57.495794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:57.502490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.502936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.503741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:57.504180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:57.534484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f5b7f5f7-6786-43ac-a90f-6002f9cd1839 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043612 May 26 21:42:57.535042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 804/1602] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:58.205315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:58.206159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:58.213328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.213788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.214565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.215007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.245272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-325bb611-8d68-43cd-9286-4b02a2ab871b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 May 26 21:42:58.245838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 799/1603] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:58.546645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:58.547552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:58.554032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.554474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.555812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:58.556253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:58.585565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d3e80c60-e0d5-4ce5-b765-2fe5cc4d5f1f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042818 May 26 21:42:58.586163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 805/1604] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:59.256798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:59.257720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:59.264481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.264960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.265721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.266159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.294775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8ea59f21-e3d9-4276-bdac-6d30ad937826 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041988 May 26 21:42:59.295323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 800/1605] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:42:59.597327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:42:59.598251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:42:59.604695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.605148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.605907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:42:59.606345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:42:59.637325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b977db68-1bc1-41e9-859c-00938e2e2b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 May 26 21:42:59.637895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 806/1606] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:42:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:00.306286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:00.307220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:00.313724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.314183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.314946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.315389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.344570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d64ececb-26b7-4bc5-9d9f-8d7bd8203434 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042764 May 26 21:43:00.345150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 801/1607] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:00.649772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:00.650699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:00.657369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.657823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.658590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:00.659022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:00.662815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:00.690674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6d9e9886-1326-4b0c-b994-58c6fefa2f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 May 26 21:43:00.691251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 807/1608] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:01.356933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:01.357845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:01.364495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.365115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.365879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.366317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.398562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cd7bf52a-15b6-4e39-8b51-3e3e236085c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046376 May 26 21:43:01.399121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 802/1609] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:01.702472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:01.703307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:01.710403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.710866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.711634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:01.712074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:01.740993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e380a85-9c80-4108-8c95-9640efb7613c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042556 May 26 21:43:01.741549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 808/1610] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:02.410517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:02.411560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:02.419577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.420026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:02.420856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.421299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:02.452017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6a93e281-8abd-424e-86cc-2d8db675468b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 May 26 21:43:02.452601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 803/1611] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:02.753312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:02.754458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:02.762118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.762575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:02.763355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:02.763796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:02.792109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ba7bceeb-5e25-4748-baac-c605834b68d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042765 May 26 21:43:02.792695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 809/1612] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:03.464410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:03.465356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:03.471952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:03.472406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:03.473206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:03.473649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:03.503200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1144db7a-3e2c-4255-a882-0deb3a8d2499 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 May 26 21:43:03.503766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 804/1613] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:03.803583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:03.804516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:03.811461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:03.811842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:03.812646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:03.813086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:03.848717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-954711d3-972c-4cc7-94d8-b032cf26e76d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049059 May 26 21:43:03.849279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 810/1614] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:04.515633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:04.516552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:04.523004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.523454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.524828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.525264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.554336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-409699ce-c83f-4f39-8c35-c2f9cdc02676 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042577 May 26 21:43:04.554901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 805/1615] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:04.860459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:04.861326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:04.868347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.868824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.869576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:04.870007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:04.898795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e9197c81-d906-4242-8a64-e793e2c7fdc9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042355 May 26 21:43:04.899334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 811/1616] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:05.566040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:05.566958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:05.573458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.573912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.574704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.575175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.604778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0afe5b0e-95b4-4609-a9c7-e78a0534754f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 May 26 21:43:05.605382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 806/1617] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:05.909928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:05.910780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:05.917935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.918386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.919149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:05.919589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:05.948493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-38b31461-5c3f-4bda-a40d-2c5e37bf6dfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042589 May 26 21:43:05.949086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 812/1618] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:06.616262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:06.617285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:06.624829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:06.625285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:06.626074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:06.626518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:06.629385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:06.658900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24547faf-9973-4cac-83fc-6f7f1fa82019 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 May 26 21:43:06.659482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 807/1619] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:07.086857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:07.087788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:07.093796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.094253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:07.095014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.095458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:07.124791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9f046a52-f93c-4ea5-8f88-7e44c215b0d1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.168386 May 26 21:43:07.125672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 813/1620] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:07.804364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:07.805825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:07.812148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.812629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:07.813412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:07.813850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:07.844440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fd52129f-4a23-40e0-8220-98085bb8bd8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.177516 May 26 21:43:07.845063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 808/1621] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:08.137354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:08.138198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:08.144802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:08.145261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:08.146031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:08.146474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:08.176191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8dd94afa-294c-4d40-953e-d3600604dc7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043406 May 26 21:43:08.176801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 814/1622] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:08.856824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:08.857915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:08.866115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:08.866569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:08.867955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:08.868395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:08.898474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1166ce89-309c-48a8-a89e-5437b7a34de3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045506 May 26 21:43:08.898947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 809/1623] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:09.188305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:09.189195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:09.195675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.196132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.196993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.197383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.227009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7fa61abe-cc31-4f4e-bed9-f27f26ad22c8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 May 26 21:43:09.227592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 815/1624] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:09.910414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:09.911327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:09.918361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.918810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.919569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:09.920007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:09.948179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f01c7ff5-4e3e-4737-b189-f6aa4ac883a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041688 May 26 21:43:09.948746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 810/1625] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:10.239293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:10.240211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:10.247027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.247579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.248285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.248755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.279183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6059d162-9ebe-49c2-a052-c9bc7c597e6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 May 26 21:43:10.279750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 816/1626] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:10.959461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:10.960372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:10.967358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.967805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.968562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:10.969020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:10.997910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b35886f7-4f53-4cb4-8802-0b9a830720fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042400 May 26 21:43:10.998450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 811/1627] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:11.290490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:11.291404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:11.297847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:11.298293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:11.299045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:11.299476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:11.329044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-df3f3617-5f6b-43c5-9663-95064f0db115 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042955 May 26 21:43:11.329626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 817/1628] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:12.010320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:12.011236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:12.017694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.018144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.018906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.019357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.047936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7d72bd48-7166-4aec-9a18-dab32c2b17c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042474 May 26 21:43:12.048487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 812/1629] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:12.340950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:12.341887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:12.348460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.348957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.349725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:12.350168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:12.379250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-208a8c57-d392-4159-b00a-01ce264d1039 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042486 May 26 21:43:12.379834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 818/1630] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:12.457310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:43:12.457591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:43:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:43:13.060939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:13.061858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:13.068263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.068674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.069430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.069865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.098535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b7fc5f59-5a2b-4202-b524-f50cdd1a245d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 May 26 21:43:13.099093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 813/1631] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:13.391273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:13.392198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:13.394618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:13.399308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.399749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.400503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:13.400958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:13.430795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6eae96a8-8db5-4e90-925f-502c0654fa40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 May 26 21:43:13.431342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 819/1632] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:14.110915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:14.111876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:14.118683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.119134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.119905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.120452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.153760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4cb31a4-eff3-4f5f-93c8-6d05ef2e822f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047237 May 26 21:43:14.154345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 814/1633] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:14.443405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:14.444329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:14.451967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.452415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.453225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:14.453663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:14.483664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ae39fa9-b0f4-4290-ad2b-dec4c9ee2aa1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044251 May 26 21:43:14.484235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 820/1634] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:15.166658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:15.168253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:15.174687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.175139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.175929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.176344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.206826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f975cb4c-13c8-4caf-a89b-ac218d2982b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 May 26 21:43:15.207412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 815/1635] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:15.495553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:15.496497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:15.503724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.504100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.504905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:15.505356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:15.535467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ead2bf4c-d9f8-4971-882b-56fab129e6f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043992 May 26 21:43:15.536032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 821/1636] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:16.218397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:16.219321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:16.225821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.226298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.227065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.227505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.256012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-42d373fb-9ea6-412c-be51-1516f411dc5c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041562 May 26 21:43:16.256561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 816/1637] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:16.546903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:16.547860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:16.554464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.554915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.555686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:16.556125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:16.585951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6b65981d-6a76-449f-95ce-c3b672887382 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 May 26 21:43:16.586514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 822/1638] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:17.267360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:17.268269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:17.274654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:17.275754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:17.276540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:17.277004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:17.304525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2f0f14f-d4c5-4831-b37d-6b711d00717c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 May 26 21:43:17.305100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 817/1639] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:17.596935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:17.597848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:17.604392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:17.604868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:17.605624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:17.606059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:17.630641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:17.635725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7100e3d2-4b85-49b3-86aa-50ddce9a5d4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042797 May 26 21:43:17.642957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 823/1640] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:18.315363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:18.316285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:18.322761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:18.323214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:18.323977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:18.324470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:18.354005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e2dbe8ff-8a3e-4b29-8e0b-658f55ca8878 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 May 26 21:43:18.354562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 818/1641] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:18.648897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:18.649742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:18.657363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:18.657816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:18.658594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:18.659035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:18.690749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8accd2fe-0b80-4148-a908-6db9a668756d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 May 26 21:43:18.691322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 824/1642] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:19.365616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:19.366776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:19.373893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:19.375890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:19.375890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:19.375890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:19.404410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db7942e2-0e6c-4f82-b9a0-69a4afc9bccd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042614 May 26 21:43:19.404927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 819/1643] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:19.701655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:19.702576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:19.709067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:19.709517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:19.710280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:19.710718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:19.740159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-724e6830-1496-41ac-9d93-d97e0057d589 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042453 May 26 21:43:19.740744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 825/1644] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:20.416002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:20.417000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:20.423855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:20.424309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:20.425125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:20.425567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:20.454704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d5ef3a0-d132-43ae-9283-aea00882c8f8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043182 May 26 21:43:20.455276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 820/1645] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:20.751787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:20.752885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:20.759443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:20.760186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:20.760980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:20.761425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:20.791869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96e1326d-1420-483f-9441-0ed35a111842 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 May 26 21:43:20.792431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 826/1646] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:21.466574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:21.467498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:21.473956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:21.474412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:21.475196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:21.475637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:21.505040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2c17e62e-09f8-4d0e-9662-bde58237ea13 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042302 May 26 21:43:21.505600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 821/1647] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:21.803459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:21.804382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:21.811804 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:21.812276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:21.813066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:21.813528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:21.842874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9df1a788-2276-4679-8f49-226aed928be6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 May 26 21:43:21.843420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 827/1648] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:22.516840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:22.517766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:22.524327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:22.525444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:22.526222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:22.526663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:22.554645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-29dcf78a-091d-477f-bad4-5dd651a66b53 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 May 26 21:43:22.555206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 822/1649] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:22.855059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:22.855966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:22.862619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:22.863063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:22.863821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:22.864252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:22.892418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8627c37-976f-4253-961a-ab907c656747 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041955 May 26 21:43:22.892989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 828/1650] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:23.566320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:23.567284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:23.569640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:23.576485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:23.576485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:23.577310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:23.577761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:23.603995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:23.608572 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-56e5d04a-aec8-44a2-94f0-bcfc3db8a538 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046251 May 26 21:43:23.609170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 823/1651] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:23.904634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:23.905651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:23.912065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:23.912512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:23.913301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:23.913732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:23.942137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3433af48-ef5b-4c85-8373-3489df6049a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042037 May 26 21:43:23.942680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 829/1652] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:24.620464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:24.621431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:24.628474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:24.628946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:24.629723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:24.630160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:24.658684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6481c544-cf3f-42b3-abd3-ecd3b5b44ecc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 May 26 21:43:24.659230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 824/1653] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:24.953958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:24.954795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:24.961496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:24.961940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:24.963204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:24.963634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:24.992024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c88b3f4b-e583-427c-bae7-27291cdfbc5c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042190 May 26 21:43:24.992567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 830/1654] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:25.670356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:25.671785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:25.678595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:25.679045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:25.679827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:25.680278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:25.709778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70e849f7-d98a-4f3e-afff-671b135e5548 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 May 26 21:43:25.710349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 825/1655] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:26.003631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:26.004551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:26.011926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:26.012371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:26.013241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:26.013585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:26.041878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1f4c530d-f10e-4687-97bc-a751633674b3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042193 May 26 21:43:26.042424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 831/1656] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:26.721442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:26.722447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:26.729630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:26.730195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:26.730849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:26.731293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:26.762037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c4d15529-cb82-486f-93f9-3051741daa1c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044488 May 26 21:43:26.762608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 826/1657] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:27.053459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:27.054385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:27.060889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:27.061345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:27.062110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:27.062559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:27.092042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ffacf939-4bcc-4818-96c7-c07ac389a668 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 May 26 21:43:27.092601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 832/1658] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:27.773151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:27.774073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:27.780914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:27.781368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:27.782135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:27.782576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:27.811560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-58e68ee5-ba58-45a9-bd46-d7da50ba70cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042297 May 26 21:43:27.812126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 827/1659] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:28.103704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:28.104642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:28.111048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:28.111501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:28.112317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:28.112789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:28.141983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-67a87100-fd61-41b8-9537-9d36a782b17b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042210 May 26 21:43:28.142532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 833/1660] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:28.822918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:28.823837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:28.832547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:28.832547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:28.832547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:28.832547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:28.861038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-62b67812-46e8-4f5a-8f77-6efb28054964 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041874 May 26 21:43:28.861588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 828/1661] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:29.154279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:29.155127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:29.161590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:29.162049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:29.162821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:29.163266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:29.191409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-81325f67-c1db-443b-acab-f59faeb88243 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041786 May 26 21:43:29.191951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 834/1662] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:29.873265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:29.874281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:29.880654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:29.881203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:29.881857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:29.882288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:29.916962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-94984638-16b1-4534-9120-d21199be9d09 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048146 May 26 21:43:29.917563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 829/1663] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:30.202926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:30.203786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:30.210258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:30.210707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:30.211469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:30.211912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:30.241072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-edb45329-56f9-4437-856d-9c6cf5f8b74c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042161 May 26 21:43:30.241621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 835/1664] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:30.929300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:30.929955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:30.937233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:30.937956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:30.938748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:30.939226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:30.968735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f5951c1-922b-4221-9e58-8c36ce231c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 May 26 21:43:30.969285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 830/1665] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:31.252888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:31.253813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:31.261437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:31.261892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:31.262711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:31.263246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:31.291965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-32825ab5-a115-488b-95c2-8d55f29d6a50 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043065 May 26 21:43:31.292445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 836/1666] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:31.980727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:31.981807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:31.988208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:31.988671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:31.989442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:31.989875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:32.018829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bdfb9222-8656-4aee-be36-ccd1c535befc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042636 May 26 21:43:32.019384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 831/1667] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:32.303418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:32.304338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:32.312764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:32.312764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:32.312764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:32.312764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:32.342774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-274597ec-afdc-4f79-a6e2-ea3c2b3f9cb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 May 26 21:43:32.343260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 837/1668] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:33.031396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:33.032903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:33.039344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:33.040870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:33.041719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:33.042634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:33.071597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a7ec51f4-eed8-499a-93f3-5fab4750b879 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043995 May 26 21:43:33.072155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 832/1669] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:33.354337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:33.355256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:33.361858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:33.362307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:33.363487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:33.363930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:33.393439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-615268ea-e682-4e87-91f3-544ad7d32d40 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043785 May 26 21:43:33.394000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 838/1670] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:34.083620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:34.084547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:34.091101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:34.091555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:34.092329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:34.092803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:34.121720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-12707f4e-4e77-4a5c-a472-d7347d781891 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042582 May 26 21:43:34.122277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 833/1671] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:34.405245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:34.406167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:34.412645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:34.413101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:34.413867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:34.414307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:34.444708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-51548030-bff3-40fb-ae9a-59fb7eab5e30 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043371 May 26 21:43:34.445178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 839/1672] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:35.133372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:35.135458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:35.142329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:35.143097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:35.144330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:35.144820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:35.174548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3c0683f7-6f2e-45d8-8a45-2cbd987fb5ee tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 May 26 21:43:35.175173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 834/1673] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:35.456329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:35.457278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:35.464030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:35.464486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:35.465285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:35.465730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:35.481936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:35.495288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fd2d3b34-221c-4484-b1fc-7d61d335d7d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042990 May 26 21:43:35.495841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 840/1674] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:36.187250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:36.188221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:36.194680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:36.195138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:36.195912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:36.196408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:36.225396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d9c5b869-521d-4f7a-b775-5e4208f71b82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042128 May 26 21:43:36.225941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 835/1675] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:36.507206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:36.508130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:36.515981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:36.516439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:36.517249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:36.517695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:36.545881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6134c9a5-bf21-483c-bc98-1949db172b7c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042634 May 26 21:43:36.546447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 841/1676] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:37.238186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:37.239114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:37.245528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:37.246003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:37.246777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:37.247208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:37.277607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c1bfcf1e-9084-4233-92ca-71a4cea6c110 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043569 May 26 21:43:37.278178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 836/1677] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:37.557652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:37.558700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:37.565303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:37.565752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:37.566512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:37.566960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:37.597629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9bbef07a-e604-40fd-a99b-9bd1a9d59283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043842 May 26 21:43:37.598174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 842/1678] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:38.288072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:38.289026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:38.295505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:38.296039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:38.296838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:38.297282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:38.327781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c27c5fcc-bf25-4706-8d70-707bf7c5c903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043556 May 26 21:43:38.330105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 837/1679] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:38.609209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:38.610118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:38.616480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:38.616953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:38.617708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:38.618653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:38.647569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e3c5eb9b-8ed9-4323-89a9-05c8774c5392 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042255 May 26 21:43:38.648125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 843/1680] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:39.339737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:39.340775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:39.347313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:39.347756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:39.348513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:39.348990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:39.379131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a5b7a87a-ed27-427f-8a2b-707564d2f557 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 May 26 21:43:39.379678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 838/1681] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:39.659277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:39.660199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:39.667282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:39.667749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:39.668517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:39.668975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:39.698672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e17337a6-4ebb-4947-9626-a8691463db1d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043361 May 26 21:43:39.699219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 844/1682] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:40.391009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:40.394539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:40.398563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:40.399018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:40.400404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:40.400877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:40.431063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c10c0bad-e0ca-4cb6-ae47-c8847dd7e697 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 May 26 21:43:40.431641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 839/1683] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:40.710310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:40.711237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:40.717733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:40.718193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:40.718960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:40.719403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:40.748173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-92cdc792-50aa-4d0d-80fe-354bddabf4f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041811 May 26 21:43:40.748750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 845/1684] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:41.442592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:41.443520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:41.450377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:41.450922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:41.451814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:41.452353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:41.466671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:41.483030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a3a56019-f420-4e60-9777-e6ac6a068923 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 May 26 21:43:41.483592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 840/1685] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:41.759749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:41.761866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:41.767283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:41.767734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:41.768497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:41.768975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:41.798418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-374b5255-4627-4695-b0a4-0f6f3b5e55f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042892 May 26 21:43:41.798972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 846/1686] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:42.494023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:42.494987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:42.501836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:42.502290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:42.503072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:42.503539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:42.533787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0ad327a-7f3e-4edb-aa9c-2bae7558229b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 May 26 21:43:42.534351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 841/1687] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:42.810034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:42.810959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:42.817557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:42.818013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:42.818776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:42.819218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:42.848612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5f7f9b49-5483-4417-86ec-4b73b2926e18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042527 May 26 21:43:42.849192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 847/1688] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:43.546180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:43.547056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:43.558180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:43.558180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:43.558180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:43.558180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:43.586430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c63de812-d1e2-46ba-858e-edf62cc645f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044378 May 26 21:43:43.587003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 842/1689] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:43.860459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:43.861339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:43.867861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:43.868310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:43.869088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:43.869522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:43.898303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f4582037-1dea-4ec1-8b78-1b419dfb0c6d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041926 May 26 21:43:43.898857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 848/1690] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:44.598189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:44.599361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:44.606084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:44.606542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:44.607315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:44.607759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:44.638593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-10a06c7e-bb37-4f76-a959-a6fff7105d95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044639 May 26 21:43:44.639155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 843/1691] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:44.909758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:44.910602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:44.912936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:44.918272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:44.918725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:44.919495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:44.919938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:44.948757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e0665675-6e84-4a83-adae-be192c5a5dd5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043025 May 26 21:43:44.949321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 849/1692] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:45.650700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:45.651653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:45.659550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:45.659993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:45.660799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:45.661234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:45.691094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71dbda36-88be-4478-88e7-c53a59332cbf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 May 26 21:43:45.691639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 844/1693] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:45.960464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:45.961328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:45.968354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:45.968846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:45.969613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:45.970045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:45.999491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-418879ca-89a5-4767-993e-099968721a62 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043077 May 26 21:43:46.000060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 850/1694] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:46.702892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:46.703879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:46.710538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:46.710934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:46.711775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:46.712287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:46.740505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70790424-29a3-4029-80f6-572be7deb306 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041407 May 26 21:43:46.741232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 845/1695] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:47.011949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:47.012892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:47.019320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:47.019766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:47.020525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:47.020988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:47.048798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-def29e12-016c-4041-b2af-ffd4727a1398 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041614 May 26 21:43:47.049343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 851/1696] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:47.752855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:47.753934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:47.761125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:47.761584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:47.762419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:47.762868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:47.793267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d19b0717-01d0-4749-9fb7-b45484c9063a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044436 May 26 21:43:47.793832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 846/1697] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:48.059604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:48.060526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:48.067308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:48.067678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:48.068467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:48.068955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:48.099179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fdfcd4be-d6fe-4b5d-9ec5-7ddf0b06699c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 May 26 21:43:48.099741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 852/1698] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:48.806228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:48.807322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:48.813932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:48.814391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:48.815161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:48.815598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:48.845929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0dfdc31a-8755-4d6f-ab8e-5039fde19a30 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 May 26 21:43:48.846522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 847/1699] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:49.110840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:49.111683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:49.118560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:49.119009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:49.119777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:49.120215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:49.149168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ba48a425-19b8-4f6d-8658-4828d013d26d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042317 May 26 21:43:49.149720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 853/1700] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:49.857372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:49.858362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:49.864925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:49.865385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:49.866164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:49.866606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:49.895886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-91bba87a-f585-4746-b4bd-d9dc6a9cb8eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 May 26 21:43:49.896460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 848/1701] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:50.160788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:50.161619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:50.167981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:50.168454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:50.169254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:50.169689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:50.200889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8dd2e187-b2ee-43a0-9a89-bcce0bf7d3e6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044077 May 26 21:43:50.201444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 854/1702] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:50.907192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:50.908110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:50.914585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:50.915068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:50.915825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:50.916260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:50.945225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fae8bda3-fc36-414e-a3f2-a9263ab9ff78 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041838 May 26 21:43:50.946329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 849/1703] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:51.212645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:51.213495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:51.219960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:51.220411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:51.221226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:51.221687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:51.251627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0e4b83b-b4ca-42d3-a6fa-769c783fbf2a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043092 May 26 21:43:51.252456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 855/1704] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:51.957243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:51.958191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:51.966376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:51.966376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:51.966376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:51.966817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:51.997569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ce46b809-254e-46b0-baf9-1f17bc885cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 May 26 21:43:51.998140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 850/1705] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:52.263490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:52.264407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:52.270936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:52.271394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:52.272156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:52.272603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:52.300750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-94e05649-1a14-4b37-ada3-f2b185aef388 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041138 May 26 21:43:52.301302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 856/1706] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:53.010404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:53.011338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:53.017769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:53.018225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:53.018997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:53.019441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:53.050590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-facb19a5-7782-4742-b12d-cc9d04bb926e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 May 26 21:43:53.051173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 851/1707] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:53.312193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:53.313144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:53.319728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:53.320180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:53.321510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:53.321951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:53.325655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:53.354076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-57db7ba7-6a26-4370-bb57-63867ed20963 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044930 May 26 21:43:53.354076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 857/1708] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:54.061355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:54.062271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:54.068730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:54.069177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:54.069959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:54.070389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:54.100970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1632b94-1ed9-48c4-b811-a1949276c665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 May 26 21:43:54.101519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 852/1709] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:54.365063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:54.365940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:54.373737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:54.374188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:54.375013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:54.375461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:54.404987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-190e631b-5b31-4836-af24-e61033a2e4f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044069 May 26 21:43:54.405544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 858/1710] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:55.112360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:55.113336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:55.115697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:55.120846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:55.121307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:55.122083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:55.122526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:55.153370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9559c159-aaf3-47bf-9538-b276e1fe59ca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 May 26 21:43:55.162831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 853/1711] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:55.416729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:55.417558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:55.423969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:55.424414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:55.425204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:55.425636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:55.454390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7b4c3c76-a0e6-4ef0-be90-6dc3e99c87cb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041744 May 26 21:43:55.454935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 859/1712] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:56.173126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:56.174086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:56.180845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:56.181306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:56.182067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:56.182503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:56.213156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d1aa64ae-aa13-4eff-8fab-1fa01aaeaa83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 May 26 21:43:56.213712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 854/1713] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:56.466019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:56.466855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:56.473420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:56.473908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:56.474717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:56.475151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:56.503953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fe4f3549-d561-4be6-966f-cefd7c7d1212 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041942 May 26 21:43:56.504511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 860/1714] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:57.225131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:57.226060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:57.232948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:57.233400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:57.234173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:57.234619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:57.265463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4d5cb7c0-efda-4ed3-9d23-cde994e96e5b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044499 May 26 21:43:57.266043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 855/1715] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:57.516958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:57.518392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:57.525992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:57.526442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:57.527281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:57.527718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:57.558460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7e2d897e-93d9-4648-9604-54bfee3ff500 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046225 May 26 21:43:57.559089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 861/1716] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:43:58.277480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:58.278410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:58.284858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:58.285313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:58.286087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:58.286529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:58.316947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ce379e2d-b4dd-476b-9426-ea81aa776bc5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 May 26 21:43:58.317760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 856/1717] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:58.570209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:58.571678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:58.578337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:58.578789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:58.579561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:58.579994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:58.610581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-245085ec-f45b-4baf-a546-f82048ac3f09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044371 May 26 21:43:58.611143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 862/1718] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:59.335426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:59.336351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:59.342842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:59.343297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:59.344060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:59.344503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:59.348137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:43:59.377133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e95d077-81ba-4e20-8fbf-4d722e2338f4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 May 26 21:43:59.377133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 857/1719] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:43:59.622871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:43:59.623711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:43:59.630130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:59.630578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:59.631338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:43:59.631779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:43:59.660869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-77b2c33c-becc-4226-8133-262678f1fc2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042028 May 26 21:43:59.661421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 863/1720] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:43:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:44:00.387815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:00.388784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:00.395758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:00.396215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:00.397025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:00.397465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:00.427583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-09dd667a-d9ef-4501-8d28-acea968f5866 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044775 May 26 21:44:00.428611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 858/1721] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:00.672505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:00.673363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:00.680543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:00.681016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:00.681778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:00.682211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:00.710395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-661856ff-f357-4091-9c5b-6a87f23227ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041961 May 26 21:44:00.710942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 864/1722] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:01.439417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:01.440244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:01.447397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:01.447849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:01.448629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:01.449066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:01.478779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d575127c-d5b7-4c9d-ac25-485cabefb162 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043356 May 26 21:44:01.479347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 859/1723] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:01.722184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:01.722997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:01.729439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:01.729891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:01.730648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:01.731093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:01.760633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7e226cd7-898f-464b-8239-4fca9ccf5749 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042548 May 26 21:44:01.761183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 865/1724] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:02.490710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:02.491642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:02.498571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:02.499032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:02.499816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:02.500262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:02.532153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-923c8c8b-0503-42d6-a78d-3b2012de2466 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045474 May 26 21:44:02.532760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 860/1725] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:02.772317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:02.773166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:02.780183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:02.780661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:02.781431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:02.781871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:02.810633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b5a7598-e2cd-4949-ad5e-f247e5369816 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 May 26 21:44:02.811185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 866/1726] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:03.543917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:03.544867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:03.551299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:03.551755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:03.552524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:03.553089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:03.583836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-019ba2c8-b467-41eb-911c-4797f0496a60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 May 26 21:44:03.584403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 861/1727] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:03.822383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:03.823454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:03.830055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:03.830507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:03.831269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:03.831706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:03.861226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ed47e46-6963-4e71-aaac-4088acfc96e7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 May 26 21:44:03.861774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 867/1728] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:04.595673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:04.596549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:04.603037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:04.603542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:04.604318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:04.604794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:04.635775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-60a0b312-d937-4a78-afd5-cea45b90ecea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 May 26 21:44:04.636369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 862/1729] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:04.873510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:04.874354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:04.881019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:04.881475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:04.882251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:04.883556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:04.914108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3dd9a6dd-ab7a-437f-8e37-ed61b1e2663d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044587 May 26 21:44:04.914680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 868/1730] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:05.647364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:05.648890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:05.655278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:05.655754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:05.656506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:05.656964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:05.688625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8bacec4e-c131-434e-9fce-868f182360ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045115 May 26 21:44:05.689198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 863/1731] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:05.924933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:05.925759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:05.932157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:05.932626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:05.933384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:05.933814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:05.962743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-450f6fa4-4ecd-4ba8-83b4-800ebbfe3f5e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041836 May 26 21:44:05.963288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 869/1732] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:06.700083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:06.701030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:06.707517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:06.707970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:06.708767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:06.709210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:06.738493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-07de5b3e-811d-4dcd-8861-c2449a0b2d71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042325 May 26 21:44:06.739066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 864/1733] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:06.973997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:06.974908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:06.982007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:06.982393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:06.983142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:06.983576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:07.011753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f4fb440-e84f-4892-876e-66f3e277e156 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041671 May 26 21:44:07.012298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 870/1734] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:07.762606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:07.763524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:07.770006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:07.770457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:07.771215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:07.771656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:07.800979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-712b8dd6-7f36-4931-b346-136751581111 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043176 May 26 21:44:07.801747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 865/1735] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:08.023232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:08.024145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:08.030658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:08.031109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:08.031884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:08.032321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:08.062210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-790e3283-c943-40de-aa90-d16ff343bc7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042732 May 26 21:44:08.062764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 871/1736] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:08.814065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:08.814956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:08.822122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:08.822575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:08.823334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:08.823770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:08.854431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b731ed05-98bd-4228-b260-6631fd0f27a1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 May 26 21:44:08.855325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 866/1737] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:09.073716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:09.074565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:09.081054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:09.081515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:09.082283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:09.082722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:09.111679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e91d5ca8-5eb6-45aa-8a19-27ee8e4bd1a8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042444 May 26 21:44:09.112420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 872/1738] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:09.866350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:09.867187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:09.873866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:09.874324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:09.875104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:09.875546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:09.906462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4891e1c-3de0-4c09-a07d-1b7958bd2cd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 May 26 21:44:09.907029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 867/1739] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:10.123399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:10.124234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:10.130719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:10.131162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:10.131919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:10.132356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:10.157190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:10.169443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-870085f7-3b84-44b3-a134-152f44e7c5c9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050115 May 26 21:44:10.170025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 873/1740] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:10.918178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:10.919047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:10.925464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:10.925917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:10.926684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:10.927123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:10.956966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c858718-99d2-46bd-a4a5-4330c47b8d84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042763 May 26 21:44:10.957529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 868/1741] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:11.182359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:11.183200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:11.190246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.190697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.191475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.191921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.221709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-75751926-392e-42db-971f-be0065fdd1ae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 May 26 21:44:11.222282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 874/1742] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:11.968464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:11.969443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:11.975994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.976441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:11.977238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:11.977672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:12.008706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b0f006db-9245-407e-863b-38f4a41afc06 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 May 26 21:44:12.009290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 869/1743] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:12.234487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:12.235450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:12.242501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:12.242836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:12.243603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:12.244108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:12.273177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cfdff460-516d-431f-ad1a-67056bd1c97a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043621 May 26 21:44:12.273708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 875/1744] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:13.020796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:13.021753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:13.029140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.029507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.030271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.030712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.062338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-77204590-bbe0-45dc-a0c1-68afb0c82f0d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045424 May 26 21:44:13.062907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 870/1745] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:13.284813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:13.285742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:13.293275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.293727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.294489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:13.294950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:13.323605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31661f0e-3b7b-4994-9f71-96d7b78e2ed6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 May 26 21:44:13.324153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 876/1746] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:14.074965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:14.075898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:14.082782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.083240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.084025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.084469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.118047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3bbd4eaf-06f0-4b23-862a-fd721d6cbd57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046956 May 26 21:44:14.118552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 871/1747] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:14.335414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:14.336335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:14.343091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.343544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.344313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:14.344782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:14.377414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6ab8b3ea-50bc-4614-ab20-2806de7e4894 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 May 26 21:44:14.377932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 877/1748] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:15.129698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:15.130658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:15.137671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.138125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.138906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.139349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.176910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e85ea6c-2357-4cb5-8039-5365dedb9c6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050963 May 26 21:44:15.177582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 872/1749] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:44:15.389340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:15.390391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:15.397041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.397491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.398887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:15.399583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:15.433779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c5655d74-a0d6-44b6-98e4-31f4bc635029 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048233 May 26 21:44:15.440281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 878/1750] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:16.189574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:16.190494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:16.197654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.198111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.198879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.199318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.223544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:16.228349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ecbe3c5-ac26-48bd-a3a0-11e912648c6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042904 May 26 21:44:16.228966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 873/1751] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:16.448148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:16.449081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:16.451361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=60 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:16.456040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.456478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.457262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:16.457746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:16.487399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c04ca1c1-88f1-4be8-b42f-d04269b7b8ea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 May 26 21:44:16.487952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 879/1752] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:17.240349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:17.241291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:17.247883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:17.248333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:17.249128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:17.249569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:17.281326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6017a742-d64e-4ed3-a3a1-1c0e1c570006 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 May 26 21:44:17.281970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 874/1753] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:17.499346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:17.500274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:17.506955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:17.507449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:17.509024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:17.509472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:17.539343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c6749918-584f-497a-9767-0b0ea6c445ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 May 26 21:44:17.539808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 880/1754] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:18.294622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:18.295551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:18.302202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:18.302657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:18.303552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:18.303998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:18.335335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba59d7f1-085d-4e8c-9f03-0660634d3368 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 May 26 21:44:18.336793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 875/1755] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:18.551428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:18.552336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:18.559712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:18.560831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:18.561069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:18.561512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:18.594282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-88c44de0-2416-45f0-b917-d341b3c6f99f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 May 26 21:44:18.594871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 881/1756] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:19.347514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:19.348477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:19.355733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:19.356185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:19.356999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:19.357440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:19.388390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6567b95a-b6c9-4152-b758-6625abf6745a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 May 26 21:44:19.389006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 876/1757] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:19.606845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:19.607767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:19.614124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:19.621884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:19.621884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:19.621884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:19.647471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-659bb969-32a6-46db-a423-11a10cd868bc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 May 26 21:44:19.647958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 882/1758] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:20.400809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:20.401733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:20.408314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.408807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.409586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.410027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.439658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ee804285-6f31-4cc3-b1d0-5c58b159c9d4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043446 May 26 21:44:20.440224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 877/1759] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:20.659331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:20.661171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:20.667170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.667626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.668418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:20.668889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:20.701165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-080dcf52-b74f-4259-a8a7-702cf50d6335 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 May 26 21:44:20.701748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 883/1760] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:21.451585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:21.452490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:21.459067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.459528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.460288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.461294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.490625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-632cec70-77aa-4f94-999a-1f4663edc742 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043063 May 26 21:44:21.491190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 878/1761] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:21.566667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:44:21.566816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:44:21.713694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:21.714611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:21.721104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.721624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.722387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:21.722816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:21.752541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e6fb8a9-c653-4bcc-9cf8-e9fbb993a0e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 May 26 21:44:21.753146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 884/1762] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:22.502371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:22.503329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:22.510413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.510873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.511637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.512104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.542590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ce04645a-ff38-4f1e-baf5-3a2620d7b920 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 May 26 21:44:22.543162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 879/1763] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:22.764766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:22.766089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:22.775093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.775557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.776348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:22.776833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:22.808122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-592e9a5d-c04f-4d4f-afa8-c38f23b3a58a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048064 May 26 21:44:22.808717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 885/1764] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:23.555067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:23.555911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:23.562858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.563302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.564073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.564506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.594371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-754b8fa7-d3ee-499e-a69e-74301191f325 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 May 26 21:44:23.594929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 880/1765] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:23.820772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:23.821648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:23.828567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.829065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.829861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:23.830304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:23.862331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9d436106-49e8-43c3-b0b6-913ed923ecb8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046412 May 26 21:44:23.862918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 886/1766] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:24.606242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:24.607179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:24.615716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:24.616376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:24.617907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:24.618630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:24.656150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e0498532-7423-4aa3-994b-d31007a42232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053859 May 26 21:44:24.657208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 881/1767] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:24.874129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:24.875157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:24.881820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:24.883097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:24.883870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:24.884307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:24.914467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-64da0ce7-c2f1-4cea-b669-38f97910dde2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044331 May 26 21:44:24.915038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 887/1768] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:44:25.594217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:25.594717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:25.600738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.601611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.602365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.602795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.627141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:44:25.668154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:25.674968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:25.675287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.675738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.676511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.676974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.706466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9999b037-5eaf-4845-9e17-c52df5e8b582 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042801 May 26 21:44:25.709196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 888/1769] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:44:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:44:25.864905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:44:25.926115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:25.927036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:25.933445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.933894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:25.934660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:25.935099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.017234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-43c7f42c-fded-4dac-9c3d-c3a6201c1b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action" status: 200 len: 75834 microversion: 2.1 time: 0.094726 May 26 21:44:26.017875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 889/1770] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:44:25 2022] POST /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9/action => generated 75834 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 26 21:44:26.719378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:44:26.720391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:26.727509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.727994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.728814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.729257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.814759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d6d96c7-a170-4eb8-bb0e-691fbfabbffd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/action" status: 200 len: 41366 microversion: 2.1 time: 0.099455 May 26 21:44:26.821963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 890/1771] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 21:44:26 2022] POST /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc/action => generated 41366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 26 21:44:26.845744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:26.846521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:26.854063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.854527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.855399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:26.855841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:26.861163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:26.873336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 46238. May 26 21:44:26.879643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=60 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:26.897309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:44:27.027403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-22db0407-347b-4df1-b2ca-e917379848cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 204 len: 0 microversion: 2.1 time: 1.436850 May 26 21:44:27.028115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 882/1772] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:44:25 2022] DELETE /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 0 bytes in 1438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:44:27.037808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:27.038541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:27.045023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.045414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.046222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.046663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.245186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:27.250211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b23edd19-282c-4b72-a159-2ba4786422ae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 204 len: 0 microversion: 2.1 time: 0.408334 May 26 21:44:27.250826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 891/1773] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:44:26 2022] DELETE /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 21:44:27.255338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-689f91f4-b795-4ee5-9d51-98bd435661df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222801 May 26 21:44:27.255907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 883/1774] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:27.260249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:27.261064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:27.267288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.267744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.268509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:27.268975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:27.454472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:27.463271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3a6d12db-3b26-44df-a032-86cd6284a7b7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.207952 May 26 21:44:27.463862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 892/1775] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:27.868224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-79d6130d-e97a-4f3a-8b24-3eb00493a2f7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] Calling method '.version_select at 0x7f46c844d790>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:27.871726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79d6130d-e97a-4f3a-8b24-3eb00493a2f7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [7d2880c4-b178-4014-8f6d-b827bee0e4f2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:44:28.274306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:28.275327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:28.282051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.282512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.283292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.283735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.418245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:28.426379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-19aa4dc1-ffb3-4751-b08a-2e97940524ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.156537 May 26 21:44:28.426947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 893/1776] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:28 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:28.481077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:28.481691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:28.487666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.492034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.492034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:28.492034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:28.622832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:28.630860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-52768f4f-b1ca-49aa-98ec-670e9cb0489c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153491 May 26 21:44:28.631444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 894/1777] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:28 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:28.879024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [None req-79d6130d-e97a-4f3a-8b24-3eb00493a2f7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] [7d2880c4-b178-4014-8f6d-b827bee0e4f2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 46270. May 26 21:44:28.984834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-79d6130d-e97a-4f3a-8b24-3eb00493a2f7 tempest-TestVolumeBootPattern-1655197124 tempest-TestVolumeBootPattern-1655197124-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1795338453" status: 202 len: 0 microversion: 2.1 time: 1.120404 May 26 21:44:28.985472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 884/1778] 10.222.0.66 () {58 vars in 1262 bytes} [Thu May 26 21:44:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1795338453 => generated 0 bytes in 1122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:44:29.444274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:29.445007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:29.451541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.451985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.452793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.453228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.649052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:29.649713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:29.658224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.658678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.659461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:29.659898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:29.750279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:29.755352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3a3ab4f1-e35c-4354-9e14-b3415a84dc4a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.315219 May 26 21:44:29.756038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 895/1779] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:29.943683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:29.952665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fbbf23c1-863b-4f5b-836e-f9e3fa90a364 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.308472 May 26 21:44:29.953383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 885/1780] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:29 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:30.773286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:30.773864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:30.780706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.781163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:30.781944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.782383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:30.970511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:30.971071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:30.978534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.978982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:30.979750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:30.980187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:31.251967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:31.261028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c75edcf9-84ff-4f27-b7c3-1b66503a45c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.491677 May 26 21:44:31.261606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 896/1781] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:31.359492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:31.368381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-16698845-3800-43ef-9ab9-f421473af163 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.401790 May 26 21:44:31.369113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 886/1782] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:32.279864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:32.280934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:32.289283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.290117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.291142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.291879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.386375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:32.387000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:32.393766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.394226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.395006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:32.395450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:32.545367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:32.553805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d864a72a-7f58-4bc4-9564-9c62f10c5a56 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.278890 May 26 21:44:32.554394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 897/1783] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:32.594973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:32.604043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cfbbf65d-a260-4bd9-9d8c-5c79ddac9fd3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221773 May 26 21:44:32.604653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 887/1784] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:33.575498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:33.577100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:33.585447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.585708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.586681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.587298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.625052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:33.625681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:33.635797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.636175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.636999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:33.637435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:33.788786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:33.807417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2758f10b-c042-4046-919f-cea1966dbb5b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.240208 May 26 21:44:33.809945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 898/1785] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:33 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:33.816807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:33.826554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3ed30d4b-991b-42b1-819c-b8413d14cd91 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209917 May 26 21:44:33.827134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 888/1786] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:33 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:34.826564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:34.827137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:34.833684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.834130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:34.834894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.835335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:34.843393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:34.844147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:34.850789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.851242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:34.852524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:34.853001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:35.127356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:35.132026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:35.134718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:35.136095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-36ff94b4-cfb8-4012-bacb-9ea11d0e3238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.313444 May 26 21:44:35.143780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 899/1787] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:34 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:35.148986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-63832a94-fa61-4fe1-a9b5-c0ae6104697e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.309376 May 26 21:44:35.149565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 889/1788] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:36.153958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:36.154600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:36.161445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:36.162205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:36.163812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:36.163812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:36.165898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:36.166511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:36.175056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:36.175418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:36.176192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:36.176666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:36.471521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:36.475195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:36.476083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-118a17f3-ca1e-4e85-b6fd-d283037364c8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.313967 May 26 21:44:36.476685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 890/1789] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:36 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:36.489033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de06d50f-55cd-4d1e-a187-b8e078f3ded2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.338811 May 26 21:44:36.490354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 900/1790] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:37.498092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:37.498737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:37.509438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:37.511359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:37.516392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:37.516875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:37.517862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:37.518318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:37.520351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:37.521348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:37.523030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:37.523678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:37.874307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:37.885871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-20d7ef78-6db4-45d2-bf23-7ddb6a130f5b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.396548 May 26 21:44:37.886774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 891/1791] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:37.918600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:37.927122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ce7a543-ed71-4d0a-868a-7b0cd8ae82ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.423594 May 26 21:44:37.927815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 901/1792] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:38.835771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:44:38.836439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:44:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:44:38.903367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:38.903989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:38.910367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:38.910826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:38.911596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:38.912224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:38.945301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:38.945918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:38.952779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:38.953232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:38.953998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:38.954433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:39.115459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:39.124593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4e155982-f82f-48b0-b32f-4a8e1d884004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224839 May 26 21:44:39.125205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 892/1793] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:39.141992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:39.150036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0ab24194-323f-4532-ab79-8fc50e65d7b9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.209138 May 26 21:44:39.150599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 902/1794] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:40.145176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:40.146321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:40.153898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:40.154270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:40.155028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:40.155462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:40.166801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:40.167479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:40.173903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:40.174600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:40.175367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:40.175872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:40.369695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:40.371946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:40.378634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0c1f876-22b6-48a2-97d6-32d58782a119 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.240247 May 26 21:44:40.381279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 893/1795] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:40 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:40.381493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-28961561-e4f0-472a-b553-9332c5e774c5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217334 May 26 21:44:40.381493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 903/1796] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:41.397018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:41.397631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:41.399457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:41.400095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:41.404905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:41.405366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:41.406135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:41.406574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:41.406703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:41.407105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:41.407865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:41.408297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:41.600074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:41.604082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:41.608473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b11c4a40-6171-44dd-8265-51f948a93ec7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215285 May 26 21:44:41.609141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 894/1797] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:41.612110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4b3f29ab-9938-4d70-89f5-ae8ab3634a55 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217196 May 26 21:44:41.612951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 904/1798] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:41 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:42.626268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:42.626886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:42.629331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:42.630011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:42.633583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:42.634036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:42.634803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:42.635240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:42.637022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:42.637479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:42.638252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:42.638693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:42.826598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:42.834581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:42.835543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-64415e23-5b89-4b7f-a684-ce501c44f982 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.213049 May 26 21:44:42.836627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 895/1799] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:42.843423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-348cdc96-9d41-4884-aba9-b0381b8e2be4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217886 May 26 21:44:42.844188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 905/1800] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:43.852517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:43.861450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:43.861882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:43.862597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:43.868401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:43.868884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:43.869685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:43.870131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:43.870321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:43.870841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:43.871675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:43.872182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:43.876777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:44.065537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:44.069435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:44.073608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0340e049-8c2d-4286-9b0d-4c8a145404d9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224811 May 26 21:44:44.074175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 896/1801] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:44.077656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b6cc4f7d-ddaa-417f-952f-d03b94ba4662 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220165 May 26 21:44:44.078214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 906/1802] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:43 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:45.091008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:45.091745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:45.094221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:45.094841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:45.098601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:45.099053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:45.099950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:45.100413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:45.101419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:45.101879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:45.102796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:45.103087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:45.299444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:45.308774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b5abf7f8-af7b-471c-83e3-e9aec893989e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217994 May 26 21:44:45.309355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 907/1803] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:45.311310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:45.320849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2976b922-ca67-437b-a14c-1a57aee1d1d3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.232792 May 26 21:44:45.321378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 897/1804] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:46.326483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:46.327087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:46.333582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:46.334025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:46.334771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:46.335200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:46.342760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:46.343383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:46.349805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:46.350262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:46.351030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:46.351471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:46.535668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:46.539863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:46.544036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-627b74ab-5a5d-482d-8a06-91acc5966161 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221284 May 26 21:44:46.544640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 908/1805] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:46 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:46.547839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f55c061e-6d75-4f6c-a65e-7e08f6a83bc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.208865 May 26 21:44:46.548399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 898/1806] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:46 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:47.561289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:47.561872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:47.564339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:47.564468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:47.569214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:47.569547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:47.570008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:47.570788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:47.571232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:47.572697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:47.573154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:47.573933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:47.574371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:47.769224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:47.772121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:47.777737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1b22af2a-80de-4ae7-886d-02a9bf3e225a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220463 May 26 21:44:47.778316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 909/1807] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:47.780747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1df755b7-7f3b-419a-9a7e-908a2996a8d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220072 May 26 21:44:47.781308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 899/1808] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:48.795199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:48.795812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:48.798496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:48.799109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:48.802397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:48.802841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:48.803610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:48.804043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:48.805191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:48.805640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:48.806394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:48.806823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:49.258550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:49.267027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:49.267364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6fe18978-7bca-4f0e-8f71-7304e0a58f6b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.475994 May 26 21:44:49.267979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 910/1809] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:48 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:49.275021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ccde9373-bd9f-4094-b9b5-57bee2d547b6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.480482 May 26 21:44:49.275603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 900/1810] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:48 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:50.284113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:50.284760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:50.291018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:50.291489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:50.291658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:50.291794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:50.292516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:50.292969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:50.298114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:50.301065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:50.301065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:50.301065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:50.490025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:50.495099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:50.499097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8029eabc-4da4-4f7c-9301-49c796528bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218733 May 26 21:44:50.499680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 911/1811] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:50.503659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b66c4334-cec2-4982-b72e-a228e073390e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216422 May 26 21:44:50.504308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 901/1812] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:51.521228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:51.521878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:51.525746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:51.526535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:51.532862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:51.533322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:51.533462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:51.534019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:51.534154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:51.534725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:51.534826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:51.535215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:51.732617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:51.735869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:51.740740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3a28fb1c-41fb-4c98-a215-1c21836b8f3f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228130 May 26 21:44:51.741382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 912/1813] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:51.745018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2aad61b1-e301-4240-a594-45b1725cd459 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227437 May 26 21:44:51.745584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 902/1814] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:51 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:52.759429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:52.760139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:52.762731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:52.763343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:52.766776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:52.767225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:52.768047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:52.768434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:52.770100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:52.770595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:52.771372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:52.771814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:52.962376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:52.966223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:52.970395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3369cb27-1a6d-4c93-880b-85d349a44289 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215793 May 26 21:44:52.971088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 913/1815] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:52.974329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e3427674-fcdf-4ab8-81bf-7ec0f81feeb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215406 May 26 21:44:52.974887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 903/1816] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:53.987700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:53.988306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:53.991016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:53.991642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:53.995107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:53.995357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:53.996145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:53.996596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:53.998198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:53.998658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:53.999612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:54.000057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:54.192186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:54.202148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3a99f912-4507-4876-8361-ebd7c5ace3f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218174 May 26 21:44:54.202632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 914/1817] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:53 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:54.205589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:54.214337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-66fcd0e3-06aa-4b2c-bb06-14c79e55bcdc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227176 May 26 21:44:54.215010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 904/1818] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:53 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:55.219481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:55.220151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:55.226828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:55.227286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:55.228067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:55.228516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:55.231915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:55.232546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:55.238898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:55.239349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:55.240121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:55.240559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:55.431215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:55.434387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:55.442847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-19a2e41b-7d05-4dd6-8e2f-93be7354f387 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215248 May 26 21:44:55.443599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 905/1819] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:55 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:55.445912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-73046911-d743-41d5-8831-b28d6f47a2d6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.230249 May 26 21:44:55.446477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 915/1820] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:55 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:56.459731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:56.460368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:56.463312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:56.463933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:56.467916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:56.468378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:56.469183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:56.469626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:56.471418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:56.471980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:56.472665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:56.473210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:56.487480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:56.676450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:56.680745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:56.684831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bea0948d-35ce-4b22-b686-58f615934a27 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.228974 May 26 21:44:56.685408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 906/1821] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:56 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:56.688937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a0ff9421-c451-4427-af58-ff2545bab39f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.230020 May 26 21:44:56.689496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 916/1822] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:57.701766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:57.702377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:57.704376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:44:57.706069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:57.706697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:57.709111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:57.709555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:57.710315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:57.710750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:57.713291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:57.715097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:57.715097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:57.715097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:57.907882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:57.912061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:57.915884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf82a532-50bf-4f8f-b7cf-cd0d8e0dc653 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217954 May 26 21:44:57.916449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 907/1823] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:57.920117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0954df51-99ee-42ad-9faf-fd0b5151bff1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217861 May 26 21:44:57.920730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 917/1824] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:44:58.932425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:58.933079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:58.936556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:44:58.937197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:44:58.940996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:58.941454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:58.942338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:58.942779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:58.943536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:58.943990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:58.944785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:44:58.945223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:44:59.146433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:59.150518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:44:59.155168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c8c92df-8004-469c-bd3f-105ea5801b28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.226807 May 26 21:44:59.155733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 908/1825] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:58 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:44:59.159310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4a74779-c206-446f-b24a-04c167c54eb7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226455 May 26 21:44:59.159949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 918/1826] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:44:58 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:00.172830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:00.173399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:00.175482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:00.176108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:00.180085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:00.180535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:00.181323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:00.182281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:00.183047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:00.183500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:00.184275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:00.184748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:00.384136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:00.384277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:00.388752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-85bb6696-c1a8-4d5a-817b-96dbc2e792e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220087 May 26 21:45:00.389322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 909/1827] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:00 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:00.393130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2e6b0583-cb62-41a2-a4c2-f2e094813af7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221442 May 26 21:45:00.393705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 919/1828] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:01.406662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:01.407283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:01.409913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:01.410528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:01.413910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:01.414377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:01.415141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:01.415584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:01.416862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:01.417307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:01.418064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:01.418490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:01.612416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:01.615368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:01.621069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1f5be657-3e37-45aa-8c32-c09c4277a65d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214852 May 26 21:45:01.621650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 920/1829] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:01 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:01.623859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ebfa468-027c-49ef-b881-f494482f101c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221117 May 26 21:45:01.624720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 910/1830] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:01 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:02.638832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:02.639449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:02.640873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:02.641495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:02.646016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:02.646473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:02.647245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:02.647692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:02.647869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:02.648327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:02.649131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:02.649568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:02.850525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:02.854647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:02.858780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0e50c084-bf48-4590-b98c-8d42cfa75bdd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221611 May 26 21:45:02.859360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 911/1831] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:02.862783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cef798e3-d2e6-4531-aa3a-bb544d93459b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227848 May 26 21:45:02.863428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 921/1832] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:03.875781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:03.876405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:03.879586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:03.880213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:03.883698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:03.884155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:03.885289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:03.885422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:03.887629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:03.888100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:03.889096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:03.889536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:04.089884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:04.093401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:04.096881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:04.098192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f12f397f-b76c-4237-ab44-f6cd199d1ada tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.226405 May 26 21:45:04.098776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 912/1833] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:03 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:04.101646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-efeec3ed-67e3-4129-bfaf-39e6e8a20189 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225890 May 26 21:45:04.102369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 922/1834] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:03 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:05.115348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:05.116044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:05.118555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:05.119173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:05.122464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:05.122881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:05.123637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:05.124071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:05.125704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:05.126152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:05.127094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:05.127536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:05.325947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:05.333964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:05.334134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f878270-8592-4241-96a8-349d80192603 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222584 May 26 21:45:05.334734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 913/1835] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:05 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:05.342248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2dc077d6-85b6-429a-b372-32e46f9ddf7b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227835 May 26 21:45:05.342814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 923/1836] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:05 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:06.350942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:06.351606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:06.358964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:06.359419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:06.359782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:06.360558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:06.360792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:06.360991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:06.367702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:06.368152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:06.368967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:06.369406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:06.562279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:06.566927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:06.570619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-64c52404-01c4-4b40-9724-17b7fad5063d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223462 May 26 21:45:06.571199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 914/1837] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:06 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:06.576637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c8773324-3378-4fb2-9b81-d2492b26e156 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220708 May 26 21:45:06.577311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 924/1838] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:07.588984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:07.589605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:07.593120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:07.593773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:07.596172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:07.596655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:07.597430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:07.597869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:07.600331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:07.600814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:07.601575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:07.602098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:07.795338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:07.802099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:07.803525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4f3ea2f4-0768-4c19-ae06-ec0a79c995e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218574 May 26 21:45:07.804368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 915/1839] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:07 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:07.810589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4312185a-3984-4153-860a-60d11a1be452 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221413 May 26 21:45:07.811291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 925/1840] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:08.820767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:08.821391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:08.827407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:08.828029 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:08.828646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:08.829102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:08.829872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:08.830311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:08.834394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:08.834846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:08.835603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:08.836040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:09.025770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:09.030570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:09.034556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed4896c3-b845-47b1-96ae-21ccde87976a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.211392 May 26 21:45:09.035146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 926/1841] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:08 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:09.039731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8a2a0616-5224-4071-90fe-02fea8ee1872 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222790 May 26 21:45:09.040307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 916/1842] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:08 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:10.051773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:10.052437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:10.057366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:10.057990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:10.059257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:10.059719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:10.060497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:10.060981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:10.064613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:10.065087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:10.065864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:10.066313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:10.260013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:10.264377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:10.269382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1ab6b35a-81ed-43f2-9e86-1f8708c45ed6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221403 May 26 21:45:10.269963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 927/1843] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:10.272513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ad5b8960-1143-42ae-aca0-70e8672ec961 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219611 May 26 21:45:10.273107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 917/1844] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:10 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:11.288391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:11.294139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:11.294419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:11.294419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:11.295960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:11.296407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:11.297237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:11.297651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:11.298547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:11.299029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:11.300084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:11.300611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:11.491501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:11.497007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:11.500483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-88e0b99f-e6ff-4cff-9df7-7ccef0b1174d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216973 May 26 21:45:11.501278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 928/1845] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:11.505073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0f5f170e-5ea1-4a3d-b9c2-5bac211cf35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219053 May 26 21:45:11.505808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 918/1846] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:12.518145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:12.518772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:12.523136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:12.523860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:12.525520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:12.526637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:12.527404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:12.527847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:12.531116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:12.531575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:12.532346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:12.532814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:12.722358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:12.730633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d4cde194-1cbf-4774-aab0-726bbb3645ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216479 May 26 21:45:12.737096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 929/1847] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:12.737286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:12.741442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbf7cfac-1458-4289-bf63-a92c1a63a88a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222199 May 26 21:45:12.741996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 919/1848] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:13.748161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:13.748815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:13.755443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:13.755898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:13.756967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:13.757404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:13.758250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:13.758863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:13.765785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:13.766227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:13.766985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:13.767409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:13.953783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:13.957352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:13.961897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15d19f13-ac63-4810-b166-544471810b50 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218141 May 26 21:45:13.962492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 930/1849] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:13.965485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d37c4b39-fef8-473a-819e-574be8a6dbf5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.211209 May 26 21:45:13.966061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 920/1850] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:14.978504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:14.979109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:14.982289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:14.982910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:14.985564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:14.986013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:14.986786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:14.987227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:14.990517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:14.991187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:14.992389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:14.993168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:15.183384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:15.186584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:15.191464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bcb0a5e8-d289-4dc5-82d6-1a6d45d60b88 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216927 May 26 21:45:15.192046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 931/1851] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:15.194861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a96f5f4e-2709-4295-ad06-95154ee39d00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216291 May 26 21:45:15.195927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 921/1852] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:14 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:16.209246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:16.209849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:16.212179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:16.212808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:16.217297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:16.217783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:16.218596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:16.219036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:16.219935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:16.220390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:16.221189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:16.221630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:16.420882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:16.426571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:16.434202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-72f5b58f-7b77-4b3f-a4d0-db839e0d862f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228576 May 26 21:45:16.435145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 932/1853] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:16 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:16.438687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-787a2994-fa60-4fa4-af52-9fc807662e4f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.230276 May 26 21:45:16.439253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 922/1854] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:17.452651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:17.453277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:17.455294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:17.455916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:17.459991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:17.460445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:17.461250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:17.461689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:17.462394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:17.462854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:17.463625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:17.464069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:17.468070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:17.655959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:17.660069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:17.664077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5a1f9e95-0de0-48f5-9733-9fc66a6de09c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215841 May 26 21:45:17.664691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 933/1855] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:17.668938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-21fa256b-a51d-455c-b81a-c7c5fe69daaa tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217309 May 26 21:45:17.669512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 923/1856] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:17 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:18.681699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:18.682316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:18.684369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:18.687017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:18.687532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:18.689236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:18.689716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:18.690548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:18.690996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:18.694273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:18.694727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:18.695497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:18.695932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:18.879549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:18.888917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7e5f3524-fe81-43bf-b1d6-6ced5f4b358c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.210950 May 26 21:45:18.889505 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 934/1857] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:18 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:18.892671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:18.900948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d48688ba-518d-447d-9bca-b36f0684baa9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217746 May 26 21:45:18.901521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 924/1858] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:19.905896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:19.906428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:19.913028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:19.913482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:19.914246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:19.914690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:19.918380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:19.919007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:19.925555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:19.926010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:19.926817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:19.927260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:20.117008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:20.121745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:20.125679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d4100448-b835-46af-866c-8cb64fc61372 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223645 May 26 21:45:20.126310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 935/1859] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:20.129847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2b81242-4681-4c1e-a3a1-6c3da2a8fd3a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215767 May 26 21:45:20.130416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 925/1860] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:21.143176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:21.143777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:21.146681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:21.147303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:21.150247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:21.150698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:21.151480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:21.151914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:21.153586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:21.154065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:21.154956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:21.155233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:21.348227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:21.355124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:21.356286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a25378d3-deaa-4956-a75d-1d29ed2b1f3e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217101 May 26 21:45:21.356919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 936/1861] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:21.363482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0906596f-cf14-4247-9e2f-f853fb790c61 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220461 May 26 21:45:21.364051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 926/1862] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:22.373790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:22.374387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:22.380752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:22.381533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:22.381533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:22.381760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:22.382270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:22.382700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:22.389159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:22.389618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:22.390405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:22.390848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:22.589943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:22.593374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:22.597980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2ca5128-23ad-44f4-92d9-7f768089d5a5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221053 May 26 21:45:22.598553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 927/1863] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:22.601498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e5840796-7a66-4960-a8ed-65ee1b782776 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.231489 May 26 21:45:22.601989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 937/1864] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:22 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:23.615302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:23.615918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:23.618517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:23.619128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:23.623548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:23.624005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:23.624822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:23.625262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:23.625993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:23.626437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:23.627198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:23.627634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:23.819423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:23.822783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:23.827700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3bd5f7e0-19c0-4529-b542-88a6fba30eae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216348 May 26 21:45:23.828283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 928/1865] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:23 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:23.831393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-170c6cf0-d25c-4fdc-998f-1f252ba2316c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216935 May 26 21:45:23.831967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 938/1866] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:24.845687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:24.846253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:24.847982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:24.848611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:24.852466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:24.852952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:24.853723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:24.854162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:24.855023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:24.855474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:24.856228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:24.856685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:24.875278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:25.046728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:25.053571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:25.055271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-869ef25d-f098-45cc-bea8-0827956e170e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.211000 May 26 21:45:25.055862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 939/1867] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:25.062074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c2c6e796-1ee0-4478-8036-e7c64e8c4992 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220555 May 26 21:45:25.065439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 929/1868] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:26.073564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:26.074386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:26.079200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:26.079827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:26.080854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:26.081311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:26.082081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:26.082515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:26.086378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:26.086833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:26.087609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:26.088054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:26.538840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:26.542916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:26.546931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6f10ea2b-6de3-442c-a7df-5c35d6574570 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.477697 May 26 21:45:26.547517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 940/1869] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:26.551751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e67a7b5b-d5a8-4397-b1bf-34c5091b5afe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.476324 May 26 21:45:26.552311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 930/1870] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:26 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:27.563272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:27.563893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:27.569663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:27.570453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:27.570732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:27.571172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:27.571944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:27.572388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:27.579676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:27.579676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:27.579676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:27.579676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:27.766764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:27.773633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:27.774756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f259df60-1c99-41fa-9876-27a6a23e2932 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215336 May 26 21:45:27.775339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 941/1871] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:27.782409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b84c1201-3029-4dc9-a619-0537f81d02bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216569 May 26 21:45:27.782967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 931/1872] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:28.793059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:28.793706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:28.798995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:28.799617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:28.800183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:28.800668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:28.801438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:28.801940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:28.802060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:28.806715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:28.807175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:28.807946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:28.808387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:28.997725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:29.001767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:29.006536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f7422bb8-7900-49fa-90c9-5a1d63e9a700 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217680 May 26 21:45:29.007204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 942/1873] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:28 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:29.010038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-28963cc5-fff9-4af7-9dc5-b6626a08ed04 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214872 May 26 21:45:29.011112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 932/1874] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:28 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:30.024324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:30.025020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:30.026932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:30.027540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:30.031546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:30.031998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:30.032794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:30.033236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:30.033982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:30.034457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:30.035219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:30.035646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:30.221096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:30.230491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-576f9322-9f63-41f7-9520-0e0a1f78bf1b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.209975 May 26 21:45:30.231076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 943/1875] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:30.240309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:30.248246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1e90ab91-0624-4f29-b2a8-28267827c495 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225058 May 26 21:45:30.248829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 933/1876] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:31.248108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:31.248758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:31.255316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:31.260202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:31.260202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:31.260202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:31.267017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:31.267638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:31.274463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:31.274910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:31.275711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:31.276474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:31.495827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:31.502786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:31.505686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9589e8cb-6fba-4f63-a0dc-af4a116b6bf0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.262368 May 26 21:45:31.506747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 944/1877] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:31 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:31.518704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-be837289-feec-415a-93c1-e36e036ea103 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.255965 May 26 21:45:31.519320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 934/1878] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:31 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:32.523882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:32.524483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:32.531651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:32.532111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:32.532917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:32.533357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:32.536523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:32.537181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:32.544272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:32.544690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:32.545462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:32.545901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:32.736453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:32.743394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:32.744703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6279650d-dc10-4c14-b4af-0c37ecd1dd31 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224707 May 26 21:45:32.745286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 945/1879] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:32.751737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-177317d2-15ec-4ff1-aa9a-683f2d4b7782 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218936 May 26 21:45:32.752337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 935/1880] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:33.761837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:33.762454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:33.769075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:33.769517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:33.771141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:33.771141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:33.771141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:33.771441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:33.777400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:33.777850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:33.778606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:33.779042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:33.965384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:33.972139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:33.973303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8001c842-ddfb-4e76-bfae-e117efe16d65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215249 May 26 21:45:33.973890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 946/1881] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:33 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:33.981008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-780134a6-6a41-4ce3-a5c6-eb74555c932f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215304 May 26 21:45:33.981579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 936/1882] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:33 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:34.991102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:34.991727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:34.997972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:34.998588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:34.998915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:34.999381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:35.000154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:35.000611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:35.005079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:35.005531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:35.006542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:35.006983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:35.196963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:35.200245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:35.205056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a29980e5-7af2-4ab2-a3dd-46522d5d5c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217835 May 26 21:45:35.205677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 947/1883] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:34 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:35.208308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3848204c-db55-414d-9b99-fc4a52fde33e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214725 May 26 21:45:35.208922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 937/1884] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:36.222503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:36.223066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:36.230484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:36.230937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:36.231709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:36.232151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:36.232703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:36.233332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:36.239729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:36.240184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:36.240989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:36.241434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:36.422578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:36.426625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:36.430580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-53956990-b523-44ca-9d69-f64d549dbd49 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.212085 May 26 21:45:36.431154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 948/1885] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:36.434711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d20253d6-c7c2-4e3a-ba29-06a3e97c27cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.206388 May 26 21:45:36.435278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 938/1886] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:36 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:37.447404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:37.448087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:37.451488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:37.452145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:37.454792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:37.455242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:37.456010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:37.456445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:37.458669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:37.459114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:37.459999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:37.460435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:37.655035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:37.662318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:37.664495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:37.664779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c71b4908-1de6-4f5a-b4fd-166795808fe1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221187 May 26 21:45:37.665973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 949/1887] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:37.672099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24252c21-e285-455a-ab37-46c59b7c122d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224391 May 26 21:45:37.675792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 939/1888] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:38.683862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:38.684494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:38.691055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:38.691567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:38.691887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:38.692362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:38.692774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:38.693216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:38.699249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:38.699705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:38.700475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:38.700947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:38.889314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:38.896034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:38.897300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31dbd7a2-e662-46e0-8236-f3c309844765 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217867 May 26 21:45:38.898063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 950/1889] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:38.905086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-03019373-0ecf-41fc-bd57-3dfc90e090d1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217668 May 26 21:45:38.905721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 940/1890] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:39.914369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:39.914962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:39.922152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:39.922419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:39.922892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:39.923166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:39.923277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:39.923710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:39.929575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:39.930032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:39.930798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:39.931240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:40.119500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:40.123430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:40.127779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b43e5b90-ada5-47b2-9cec-9ad9e80f6cc7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209079 May 26 21:45:40.128523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 941/1891] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:39 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:40.131685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c9e3b99d-6ab4-4dff-b9fe-0eab6569bbc6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221151 May 26 21:45:40.132282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 951/1892] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:39 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:41.145456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:41.146081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:41.147611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:41.148228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:41.152910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:41.153468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:41.154553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:41.154747 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:41.155037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:41.155384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:41.156149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:41.156658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:41.354703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:41.358865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:41.363233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a0e88d4b-ff0e-4444-8701-54687a59fc61 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219597 May 26 21:45:41.363811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 952/1893] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:41 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:41.366827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bb228df4-d77d-4048-bb36-b88cd5382dc4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225187 May 26 21:45:41.367391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 942/1894] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:42.381588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:42.382250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:42.383310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:42.383940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:42.391152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.391484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.391673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.391829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.392371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.392489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:42.392846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.392969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:42.602422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:42.606219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:42.611226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-79c588d2-72cd-4199-b2da-b52aebf10fa9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.233816 May 26 21:45:42.611816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 953/1895] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:42.614311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-55079729-97ef-471c-a451-fa624edbb722 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.235009 May 26 21:45:42.614874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 943/1896] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:43.628515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:43.629157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:43.632330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:43.632967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:43.636630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.637086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:43.637874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.638308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:43.639328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.639768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:43.640553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:43.641011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:43.837674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:43.840956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:43.846003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e95e36a-c66a-44b6-9492-21fd25007c43 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218076 May 26 21:45:43.846837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 944/1897] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:43.851033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a0c36fa1-a015-438e-850b-c800b137515d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226396 May 26 21:45:43.851821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 954/1898] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:43 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:44.863732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:44.864275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:44.867612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:44.868234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:44.870885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:44.871360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:44.872120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:44.872555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:44.874480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:44.875057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:44.875826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:44.876269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:45.077298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:45.080092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:45.085546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c3ed092d-70d1-4949-ad35-b3c51cc5c445 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225699 May 26 21:45:45.086130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 945/1899] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:44 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:45.089383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9d0b2de3-aa72-4a12-a29a-c354d4664128 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225586 May 26 21:45:45.090042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 955/1900] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:44 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:46.102996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:46.103743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:46.107380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:46.107992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:46.111035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:46.111497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:46.112275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:46.112753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:46.114550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:46.115000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:46.115767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:46.116235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:46.120274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:46.313646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:46.320992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:46.331494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-02e561c1-2140-43ed-b324-344cfce8f901 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228497 May 26 21:45:46.336244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 956/1901] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:46 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:46.336398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1c0a4f67-91ab-4aae-a4bd-9dd39ee410f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.232893 May 26 21:45:46.336398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 946/1902] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:46 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:47.349949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:47.350585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:47.351786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:47.352461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:47.357504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:47.357967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:47.358744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:47.359191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:47.359565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:47.360053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:47.360846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:47.361274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:47.562439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:47.566550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:47.570755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c7527092-8645-4243-8359-e6fcbdedb5d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224559 May 26 21:45:47.571410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 947/1903] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:47.576491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-436c5a42-c92c-426a-8162-ea1af4b518f2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.231308 May 26 21:45:47.577296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 957/1904] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:48.587466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:48.588218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:48.593246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:48.593869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:48.595012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:48.595465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:48.596225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:48.596685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:48.600498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:48.600987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:48.601756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:48.602195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:48.792727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:48.795650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:48.801105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d46c7fe1-58ec-414f-b75e-06c3487abc18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217490 May 26 21:45:48.801687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 948/1905] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:48 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:48.803820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-03c0e7ce-86e9-4fe8-a4cc-d20de4d17d52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214227 May 26 21:45:48.804399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 958/1906] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:48 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:49.818240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:49.818847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:49.819937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:49.820560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:49.822963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:49.825506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:49.825953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:49.826728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:49.827163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:49.828216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:49.828714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:49.829544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:49.837720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:50.024984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:50.028543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:50.033933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-89fd388a-2742-4324-9f64-ad056c96edba tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219483 May 26 21:45:50.034514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 949/1907] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:50.036657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8c5e90af-bb48-478c-84e8-ba523ce0c7f8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220482 May 26 21:45:50.037218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 959/1908] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:49 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:51.051416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:51.052098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:51.053361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:51.053988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:51.058788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:51.059252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:51.060025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:51.060458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:51.060879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:51.061332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:51.062110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:51.062557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:51.261910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:51.265810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:51.270906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7728512f-0e0c-4111-b5fc-6796b0c64118 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221350 May 26 21:45:51.271704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 960/1909] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:51.274396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0e063900-283f-40f8-944b-d581d97effde tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227266 May 26 21:45:51.275168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 950/1910] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:51 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:52.289265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:52.289877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:52.295116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:52.295745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:52.297109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.297566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.298349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.298789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.302091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.302541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.303302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:52.303740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:52.498783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:52.503113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:52.507252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-810cc972-6cdd-4943-be75-94e57c0c8c38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222081 May 26 21:45:52.507828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 961/1911] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:52.511679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7e20846a-dc12-457a-a207-3a3214a9add7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224385 May 26 21:45:52.512277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 951/1912] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:53.524297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:53.525084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:53.528431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:53.529180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:53.532741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.535241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:53.535241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.535241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:53.535564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.535881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:53.536673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:53.537113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:53.739381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:53.742483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:53.751620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-88f413c3-d93a-467f-9e40-521aad30c074 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.231072 May 26 21:45:53.752355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 962/1913] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:53 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:53.755409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e5e19431-f48f-49bd-bcfc-1375e71f6274 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.230436 May 26 21:45:53.755977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 952/1914] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:53 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:54.774140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:54.775291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:54.778083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:54.779451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:54.785468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:54.786200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:54.787464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:54.788213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:54.790573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:54.791307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:54.792851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:54.793573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:55.002794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:55.006877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:55.011271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3c915c69-f5a8-4cd4-8db1-602796fc5ab2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.243459 May 26 21:45:55.011960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 963/1915] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:55.015686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dbd5c83c-88cf-4dc8-8541-8c8a55e4e2ac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.246888 May 26 21:45:55.016254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 953/1916] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:54 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:56.028416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:56.029606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:56.032944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:56.033564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:56.036134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:56.036606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:56.037412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:56.037852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:56.039942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:56.040396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:56.041198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:56.042299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:56.232528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:56.236866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:56.240729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4c5e61f0-29ff-4f8a-8b29-a13b9da60546 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216207 May 26 21:45:56.241302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 964/1917] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:56.244652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c98cc9a-9caf-406c-ac8f-eef0272841d0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216052 May 26 21:45:56.245210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 954/1918] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:56 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:57.259052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:57.259669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:57.261862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:57.262492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:57.267008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:57.267608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:57.268361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:57.268828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:57.269007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:57.269463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:57.270230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:57.270671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:57.461208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:57.468613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:57.469182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f38934f0-dde7-4102-b8de-bdf528c80d48 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.211324 May 26 21:45:57.469767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 955/1919] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:57.476952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-499db277-1697-4677-b086-132bb49412c0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222005 May 26 21:45:57.477681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 965/1920] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:58.485908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:58.486518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:58.493086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:58.493535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:58.494301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:58.494415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:58.494853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:58.494977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:58.502620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:58.503083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:58.503859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:58.504304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:58.510736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:58.706771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:58.712227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:58.720467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8129a931-a913-4180-a854-4088daf26d6b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.238038 May 26 21:45:58.724624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 956/1921] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:58 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:58.728050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3da40e3b-e10e-41d1-8471-4088495c775b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.237355 May 26 21:45:58.729238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 966/1922] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:58 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:45:59.738106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:59.740168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:59.744240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:45:59.745092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:45:59.745765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:45:59.746255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:59.746708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:59.747484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:59.747922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:59.753129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:59.754164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:59.755146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:45:59.755755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:45:59.947793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:59.955335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:45:59.956998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da862896-321a-43c8-a8de-e8af678f435a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222691 May 26 21:45:59.957592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 957/1923] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:59 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:45:59.963720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-08e6118a-8181-485c-9a80-dc154537630b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222497 May 26 21:45:59.964222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 967/1924] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:45:59 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:00.974596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:00.975222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:00.981111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:00.981726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:00.981842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:00.982318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:00.983094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:00.983535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:00.988114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:00.988571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:00.989375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:00.989811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:01.180655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:01.183587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:01.189612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-906ef92b-d00e-4225-9ea9-220b07216bcf tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218911 May 26 21:46:01.190286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 958/1925] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:00 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:01.192180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1447ca7f-d3a2-4f29-a4d7-d2e38e033a9f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214813 May 26 21:46:01.192765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 968/1926] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:02.206887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:02.207507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:02.209438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:02.210363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:02.214101 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.214557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.215325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.215787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.217161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.218143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.218934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:02.219379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:02.677312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:02.680456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:02.685469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f67eca34-362f-4500-8623-2140d6b0b087 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.482549 May 26 21:46:02.686173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 959/1927] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:02.688850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9ee7b794-4439-4c55-83ef-f5abcb054b48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.483191 May 26 21:46:02.689416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 969/1928] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:03.703250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:03.703870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:03.706125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:03.706753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:03.710676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:03.711129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:03.712011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:03.712480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:03.713406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:03.713859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:03.714635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:03.715076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:03.908039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:03.915095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:03.916898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0b225d35-8e24-42f6-ac3d-de80f3defa58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217494 May 26 21:46:03.917556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 960/1929] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:03 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:03.923660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a6b3322d-55b4-4498-bbf2-76f46055beea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221435 May 26 21:46:03.924629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 970/1930] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:03 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:04.026964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.027467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.034074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.034555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.035367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.035807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.062894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:46:04.349103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-06f19ffc-1cbe-4572-802f-c6b0586f49b2 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 204 len: 0 microversion: 2.20 time: 0.325712 May 26 21:46:04.349699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 961/1931] 10.222.0.66 () {60 vars in 1279 bytes} [Thu May 26 21:46:04 2022] DELETE /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 26 21:46:04.358407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.359094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.365357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.365817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.366589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.367033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.493830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:04.502731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:04.503417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:04.504570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8b3eac4-6976-4086-b673-15a6e600cdbe tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1723 microversion: 2.20 time: 0.150622 May 26 21:46:04.505415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 971/1932] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:46:04 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:46:04.936386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.937039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.940132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:04.940793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:04.943946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.944400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.945219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.945659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.947328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.947790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:04.948560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:04.949021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:05.146974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:05.150097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:05.153906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:05.155798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b6b690ae-db18-4061-b0b9-1ba6a737cd6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223780 May 26 21:46:05.156389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 962/1933] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:04 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:05.159638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1a0383a2-2481-494d-89fe-40250e3733fc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223581 May 26 21:46:05.163323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 972/1934] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:05.523324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:05.523943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:05.530206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:05.530658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:05.531430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:05.531871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:05.741497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:05.750677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:05.752175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:05.753430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ef392443-c59c-47f2-934d-1392f84330a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1723 microversion: 2.20 time: 0.234120 May 26 21:46:05.753990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 963/1935] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:46:05 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:46:06.178902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.179696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.186182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.186941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.194630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.195335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.195998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.196697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.197154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.197937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.198999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.199673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.382786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:06.409066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f47bed6e-d4b0-4d2a-b671-e6dba2626911 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.232698 May 26 21:46:06.412058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 973/1936] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:06 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:06.693297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:06.703597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cdb8e097-009c-40ba-9971-0356ad1e4cdd tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.520377 May 26 21:46:06.713036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 964/1937] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:06.713314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-e23d279b-77b4-4c86-bd6b-f4b9059038e1 req-e96da7a7-ceeb-41ad-9a19-cb3f35f1e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de3c1b5f-d433-4d79-b190-8ff620c536b7", "name": "network-vif-deleted", "tag": "d152b7d8-b896-480f-9145-51feda66a518"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:46:06.723024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-e23d279b-77b4-4c86-bd6b-f4b9059038e1 req-e96da7a7-ceeb-41ad-9a19-cb3f35f1e6b8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.723629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-e23d279b-77b4-4c86-bd6b-f4b9059038e1 req-e96da7a7-ceeb-41ad-9a19-cb3f35f1e6b8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.737419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-e23d279b-77b4-4c86-bd6b-f4b9059038e1 req-e96da7a7-ceeb-41ad-9a19-cb3f35f1e6b8 service nova] Creating event network-vif-deleted:d152b7d8-b896-480f-9145-51feda66a518 for instance de3c1b5f-d433-4d79-b190-8ff620c536b7 on hv-cinder-82880 May 26 21:46:06.742950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-e23d279b-77b4-4c86-bd6b-f4b9059038e1 req-e96da7a7-ceeb-41ad-9a19-cb3f35f1e6b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.328925 May 26 21:46:06.743562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 974/1938] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:46:06.773896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:06.774684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:06.781977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.782432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.783654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.784122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.817051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:06.817495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:06.817950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lazy-loading 'fault' on Instance uuid de3c1b5f-d433-4d79-b190-8ff620c536b7 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:46:06.860341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:06.868705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:06.870217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7d524a8208354c2099eb3b41b0f53de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28874954ef9f45c78ad761ed4a1719cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:06.871392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-552e8b97-d4aa-4ff8-a712-9924a3bafaaa tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 200 len: 1371 microversion: 2.20 time: 0.101731 May 26 21:46:06.871936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 965/1939] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:46:06 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 26 21:46:07.442001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:07.442711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:07.450485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.451230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.452864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.453472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.589676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:07.597575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fcc81656-9c3d-49a7-a8b9-4470b9816dc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.160201 May 26 21:46:07.598139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 975/1940] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:07 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:07.720757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:07.721363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:07.727797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.728254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.729138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.729524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.855884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:07.864223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ff6e958f-ba71-4c3a-8df7-56016d9a377e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.147403 May 26 21:46:07.864816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 966/1941] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:07.889989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:07.890668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:07.896680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.897136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.897899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:07.898341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:07.911310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 HTTP/1.1 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:46:07.913007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:46:07.914860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'de3c1b5f-d433-4d79-b190-8ff620c536b7'} May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:46:07.916043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:46:07.917774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:46:07.919475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:46:07.919475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ff92c89f-4c42-4887-8d11-82d67236e2c3 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 404 len: 111 microversion: 2.20 time: 0.028250 May 26 21:46:07.919475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 976/1942] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:46:07 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:46:07.923792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-07be3a11-0eb7-43c1-938f-6cea14efdfe5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '.version_select at 0x7f46c84558b0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:08.024481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-07be3a11-0eb7-43c1-938f-6cea14efdfe5 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298626192" status: 204 len: 0 microversion: 2.20 time: 0.105020 May 26 21:46:08.025090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 967/1943] 10.222.0.66 () {60 vars in 1261 bytes} [Thu May 26 21:46:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1298626192 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 26 21:46:08.614732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:08.615343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:08.633697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.633697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:08.633697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.633697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:08.809656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:08.817934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b402c5e-f7d5-4c2c-b5cc-dba71695cee1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.207142 May 26 21:46:08.818506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 977/1944] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:08 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:08.882166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:08.882786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:08.889376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.890452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:08.891123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:08.891808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:09.024832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:09.033069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dd0dd961-11eb-4d09-903f-783289f9430a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155016 May 26 21:46:09.033665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 968/1945] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:08 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:09.835901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:09.836745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:09.844009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:09.844464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:09.845280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:09.845725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:09.980922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:09.988952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-698fb765-a539-42f6-9464-6e4787852a17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157095 May 26 21:46:09.989522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 978/1946] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:09 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:10.050728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:10.051403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:10.059747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.060202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.061052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:10.061582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:10.199768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:10.208158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cba24452-841e-4d38-9401-aa54a993a43d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.161160 May 26 21:46:10.208766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 969/1947] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:11.006422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:11.007045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:11.013763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.014202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.015513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.015945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.152416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:11.161337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dbb3691a-cd9f-4b02-984d-c31527358639 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.159011 May 26 21:46:11.161915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 979/1948] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:11.225656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:11.226282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:11.232881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.233375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.234159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:11.234600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:11.368734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:11.377387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ed2a9e4-fa5b-4ebd-a749-efabe61c237b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155619 May 26 21:46:11.377964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 970/1949] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:12.178076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:12.178686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:12.185496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:12.185956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:12.187236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:12.187676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:12.323625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:12.331850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ba784d18-3bef-404e-8d7c-33bfd6421e35 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157717 May 26 21:46:12.332421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 980/1950] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:12.395181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:12.395783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:12.402618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:12.403100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:12.403863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:12.404303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:12.546393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:12.554491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e5602c60-4747-4bd7-85a5-81795ce31d8f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.163375 May 26 21:46:12.555058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 971/1951] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:13.349518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:13.350135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:13.356613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:13.357083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:13.357843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:13.358277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:13.489695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:13.498080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-071ea601-5344-4097-a9ce-7bb1a65f442d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152277 May 26 21:46:13.498658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 981/1952] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:13.572490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:13.573271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:13.580493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:13.580969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:13.581787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:13.582233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:13.584999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:13.712567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:13.720923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5036eda-ae3a-426f-be09-38a114894648 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.152297 May 26 21:46:13.721484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 972/1953] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:14.515885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:14.516501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:14.523290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:14.523792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:14.524768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:14.525206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:14.659990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:14.673509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-660af9e6-395d-4161-b3f5-8d4151aac320 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.162041 May 26 21:46:14.674110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 982/1954] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:14 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:14.738046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:14.738667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:14.745298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:14.745756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:14.746528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:14.746970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:14.878145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:14.886532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5ae5af6-88d0-4572-b856-758f5d4826a9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153031 May 26 21:46:14.887109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 973/1955] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:15.691217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:15.691942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:15.699045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.699497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.700268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.700732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.848608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:15.857015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-560dde2f-0546-4157-92d1-f9ef83ffd2f8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.169834 May 26 21:46:15.857718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 983/1956] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:15.903311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:15.904067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:15.911291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.911750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:15.912752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:15.913205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.046748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:16.054851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8ec9a73c-b89f-45da-a159-7f4f0a5ae437 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155440 May 26 21:46:16.055422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 974/1957] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:15 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:16.874945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:16.875553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:16.882489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.882943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:16.883715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:16.884152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:17.018086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:17.026200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2d8e286d-23d3-40e9-b402-385288b4ddca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.155118 May 26 21:46:17.026708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 984/1958] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:17.072723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:17.073339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:17.082177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:17.082666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:17.083483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:17.083919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:17.218963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:17.227135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c8c46fe0-4a7c-409c-839e-0d206bfd0d92 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.158234 May 26 21:46:17.227715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 975/1959] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:18.044368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:18.045010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:18.053354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:18.053801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:18.054575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:18.055013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:18.190129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:18.198292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84007e97-24e3-4e24-99be-c7a9140e8808 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157735 May 26 21:46:18.198876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 985/1960] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:18.243558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:18.244234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:18.250924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:18.251365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:18.252142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:18.252605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:18.396248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:18.404437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-21c791eb-bcdf-439b-8805-19825a0b6aa8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.164764 May 26 21:46:18.405715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 976/1961] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:18 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:19.215214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:19.215821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:19.222617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:19.223072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:19.223858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:19.224300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:19.360330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:19.368474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b303b90b-ea9c-4d5f-bfab-3f14106f9c94 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157186 May 26 21:46:19.369478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 986/1962] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:19.422968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:19.423586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:19.430434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:19.430887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:19.431664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:19.432104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:19.571095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:19.585026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d295913a-70f1-4548-814d-99ee24f4e09d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.166266 May 26 21:46:19.585833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 977/1963] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:20.386030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:20.386603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:20.389114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:20.394611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:20.395119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:20.395819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:20.396251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:20.603228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:20.604156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:20.611764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:20.612219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:20.613102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:20.613545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:20.731385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:20.740208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-babfbcfa-3b7a-48a5-bbf6-dbd5916e771c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.358118 May 26 21:46:20.745272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 987/1964] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:20 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:20.778699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:20.786813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9eb88c1c-ea5c-423a-ab68-e4fdb870c456 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.187443 May 26 21:46:20.789789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 978/1965] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:20 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:21.757807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:21.758503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:21.765997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:21.766446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:21.767203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:21.767642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:21.806193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:21.806811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:21.814047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:21.814413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:21.815195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:21.815637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:21.959180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:21.968071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c48085d0-cbb6-455a-a87e-28ad798d9c34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214300 May 26 21:46:21.969218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 988/1966] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:21.986244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:21.995344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-13f6cb9e-7a3a-424a-844c-9599d3dc1488 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.192880 May 26 21:46:21.995919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 979/1967] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:22.985702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:22.986420 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:22.993047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:22.993492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:22.994259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:22.994696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:23.013306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:23.014094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:23.020922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:23.021383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:23.022170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:23.022625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:23.192165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:23.200445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4722a978-bde3-430d-9193-30ca4c03c196 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218652 May 26 21:46:23.201056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 989/1968] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:23.210394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:23.218841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cd9577f1-5015-4494-9e1e-a048491f1539 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.209534 May 26 21:46:23.219425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 980/1969] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:24.218114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:24.218733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:24.225364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:24.225941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:24.226694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:24.227155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:24.235375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:24.236008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:24.242858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:24.243315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:24.244104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:24.244548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:24.439269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:24.442723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:24.446919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:24.447884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2de71d44-c864-465d-b195-6c77d7719ddb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.233384 May 26 21:46:24.448627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 990/1970] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:24.455546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f859fb00-6ae2-4ac2-a85c-12c7fe70ec82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224117 May 26 21:46:24.456118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 981/1971] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:25.469584 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:25.470234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:25.472458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:25.473145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:25.477173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:25.477631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:25.478443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:25.478914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:25.480574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:25.481061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:25.481843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:25.482287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:25.681568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:25.684832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:25.691336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-736017ac-62f7-46a3-8268-b3217c48ad0c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225880 May 26 21:46:25.691959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 991/1972] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:25 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:25.693412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c885cbdd-986e-4255-800a-d004f0634c0d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224734 May 26 21:46:25.693978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 982/1973] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:25 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:26.709671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:26.710247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:26.710474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:26.711091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:26.717120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:26.717646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:26.717821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:26.718210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:26.718435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:26.718872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:26.719004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:26.719454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:26.919232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:26.923443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:26.927737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d64a22bf-f922-4444-a18c-e2839e609567 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222192 May 26 21:46:26.928321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 992/1974] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:26 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:26.931551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e5c074fe-0a95-4c44-8fe8-3c0e31a1ba4e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224871 May 26 21:46:26.932116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 983/1975] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:27.945360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:27.945984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:27.952396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:27.952931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:27.953063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:27.953208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:27.953976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:27.954419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:27.959207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:27.959675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:27.960479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:27.960932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:28.150504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:28.153832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:28.163032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8e77c285-6c9b-4c35-810d-e76c852178e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221118 May 26 21:46:28.164013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 993/1976] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:28.168240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d21353ea-9b88-4f54-8bba-df49a3807b91 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219413 May 26 21:46:28.169536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 984/1977] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:29.183275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:29.183855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:29.185641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:29.186259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:29.190939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:29.191464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:29.192242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:29.192722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:29.192838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:29.193174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:29.193931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:29.194424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:29.389184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:29.395951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:29.399102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-673f3f05-c2e5-4f0c-b433-1ea031d70a93 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219422 May 26 21:46:29.399343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 994/1978] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:29 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:29.404380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f416f5e3-7f15-4d52-90ed-dee1bd2e3116 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222448 May 26 21:46:29.404975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 985/1979] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:30.416045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:30.416554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:30.421200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:30.421918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:30.422413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:30.422862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:30.424105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:30.424234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:30.424945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:30.429512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:30.429961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:30.430739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:30.431199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:30.622732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:30.627660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:30.632245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-74764df3-4ca0-4ab0-b3ba-f33f84890f17 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220532 May 26 21:46:30.632876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 995/1980] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:30.638038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a25ccb6b-1d0d-4921-89d9-53a9c230f24d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219444 May 26 21:46:30.647054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 986/1981] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:31.650273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:31.650865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:31.653729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:31.654352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:31.657727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:31.658168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:31.658936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:31.659369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:31.661154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:31.661622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:31.662412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:31.662855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:31.857301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:31.862082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:31.866003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c287b93e-c142-4bc7-92d7-4a48bae64333 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219665 May 26 21:46:31.869436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 996/1982] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:31 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:31.870367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-884f82ff-211b-45f7-bc81-f27e39a113d0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220392 May 26 21:46:31.870925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 987/1983] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:31 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:32.465905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:46:32.466149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:46:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:46:32.883623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:32.884324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:32.888132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:32.888918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:32.891690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:32.892147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:32.893020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:32.893457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:32.895905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:32.896363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:32.898938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:32.898938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:33.087185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:33.090472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:33.092690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:33.096428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ea96c57f-5a3f-425a-923b-49a09491b4c5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216681 May 26 21:46:33.097062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 997/1984] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:33.099961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-558eb1bb-c7ca-4ce8-85a1-b59a06e376bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215818 May 26 21:46:33.100643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 988/1985] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:34.113961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:34.114529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:34.117279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:34.117936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:34.121211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:34.121668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:34.122455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:34.122897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:34.125601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:34.126097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:34.126864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:34.127308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:34.575424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:34.583262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:34.584507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f51a1e8c-651a-4808-8571-83cc3c624f72 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.474484 May 26 21:46:34.585189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 998/1986] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:34.591667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0a0aa13d-193c-42ea-8d68-b2cc81213dac tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.478358 May 26 21:46:34.592236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 989/1987] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:34 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:35.601618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:35.602233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:35.608478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:35.608992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:35.609134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:35.609303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:35.610084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:35.610523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:35.615709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:35.616169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:35.616992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:35.617434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:35.803757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:35.811846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bd656301-e251-4577-b58e-c03327f90dad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214072 May 26 21:46:35.812794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 999/1988] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:35 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:35.814630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:35.822734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5624fe20-a61e-4a7c-b10a-33de789d45e6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218062 May 26 21:46:35.823297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 990/1989] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:35 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:36.828899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:36.829439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:36.836098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:36.836551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:36.837356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:36.837797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:36.840549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:36.841282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:36.848553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:36.849043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:36.849819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:36.850359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:37.035802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:37.040210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:37.044272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b01792eb-c8eb-4391-8388-e33d6c7bf4b9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219395 May 26 21:46:37.044926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1000/1990] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:36 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:37.048795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-479ea8d1-b636-4910-a661-ff9b12f0908f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.212137 May 26 21:46:37.049370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 991/1991] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:38.064148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:38.064877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:38.065942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:38.067323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:38.071623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:38.072297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:38.073596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:38.074040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:38.074194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:38.074889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:38.075745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:38.076262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:38.272934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:38.275985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:38.282683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-05c1664b-e24b-4541-a66d-2b92ade52ba3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220587 May 26 21:46:38.283477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 992/1992] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:38.284983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0934b440-0d04-4b41-87d0-b5ba6592b19e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225675 May 26 21:46:38.286144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1001/1993] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:39.299837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:39.300445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:39.301978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:39.302735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:39.307249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:39.307742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:39.308521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:39.308991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:39.309323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:39.309771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:39.310532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:39.311022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:39.508179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:39.512380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:39.516707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-270a361e-6580-480d-b360-37caac87dd99 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220707 May 26 21:46:39.517371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 993/1994] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:39 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:39.520613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6d6cb19d-4926-4ba8-806a-5f7164a19e46 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222381 May 26 21:46:39.521163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1002/1995] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:39 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:40.535348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:40.536030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:40.537586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:40.538210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:40.542657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:40.543115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:40.543891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:40.544335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:40.544719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:40.545177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:40.545943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:40.546388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:40.741214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:40.748077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:40.754540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0a916f1e-c7ad-4ad3-bf79-8540e32fa75d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223212 May 26 21:46:40.755919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 994/1996] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:40.757347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-63e0f8aa-af0a-493e-b196-d5588752c7b5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223566 May 26 21:46:40.757909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1003/1997] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:40 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:41.772474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:41.773121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:41.773864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:41.774482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:41.779681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:41.780128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:41.780973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:41.781159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:41.781410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:41.781518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:41.782182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:41.782657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:41.978473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:41.981504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:41.987464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d071ec9c-5f19-49a5-b2d4-f4c9c5b39d06 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218904 May 26 21:46:41.988258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 995/1998] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:41 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:41.990351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c71b01f0-4272-435b-b58c-8e4b78a3685b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220189 May 26 21:46:41.991141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1004/1999] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:43.005639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:43.006302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:43.007545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:43.008173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:43.013378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:43.013759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:43.014540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:43.014829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:43.014966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:43.015300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:43.016081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:43.016533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:43.208747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:43.216946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5f9fb23-d5b0-4c04-8307-ebe8161c7921 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215399 May 26 21:46:43.220779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 996/2000] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:43.220948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:43.228044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a776aa51-7261-4e4c-9e14-41f6f6636c7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224731 May 26 21:46:43.228640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1005/2001] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:44.234583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:44.235188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:44.241875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:44.242330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:44.243112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:44.243723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:44.248793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:44.249492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:44.256756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:44.257235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:44.257979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:44.258416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:44.450892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:44.458039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:44.459363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8fa65fe0-9092-4e1d-bc14-bfa684ea3df7 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228756 May 26 21:46:44.459945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 997/2002] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:44 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:44.467075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8cad4bc1-08a0-4b77-84ed-80553aca8bfe tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222694 May 26 21:46:44.467432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1006/2003] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:44 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:45.477038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:45.477719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:45.485105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:45.485561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:45.486074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:45.486527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:45.486691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:45.486865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:45.493549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:45.493991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:45.494861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:45.495293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:45.514100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:45.693035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:45.696009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:45.701825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3168f82d-95d4-46cb-abb0-8f7480c2eadf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228616 May 26 21:46:45.702414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 998/2004] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:45.704348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-150b89d5-f1d6-4a17-958e-9d117fabe3ed tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222605 May 26 21:46:45.705124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1007/2005] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:46.719495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:46.720061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:46.722321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:46.722934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:46.726674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:46.727131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:46.727902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:46.728340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:46.729286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:46.729730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:46.730483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:46.730914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:46.930082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:46.934634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:46.940255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d981392e-5dac-4fa6-af19-2b9dd22b912e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225047 May 26 21:46:46.940884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 999/2006] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:46 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:46.942352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-08695082-b6ad-4d72-8ef3-b80ed35ffe2a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224275 May 26 21:46:46.942916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1008/2007] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:46 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:47.958856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:47.959479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:47.960948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:47.961573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:47.966499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:47.966956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:47.967731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:47.968204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:47.968338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:47.968693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:47.969467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:47.970027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:48.167255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:48.169943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:48.176465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-478b1850-fb8b-4238-a538-eb11d5da4e65 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221694 May 26 21:46:48.177174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1000/2008] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:48.180204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-df9eb796-5c43-4eb8-923d-44de627849cb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223031 May 26 21:46:48.180807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1009/2009] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:49.194548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:49.195099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:49.198298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:49.198925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:49.202291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:49.202742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:49.203514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:49.203949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:49.205526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:49.205987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:49.206759 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:49.207200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:49.402129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:49.410746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e9de4b70-0132-4ac0-b0ef-8aae5b1fba10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216790 May 26 21:46:49.411305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1010/2010] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:49.419665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:49.425129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e3f6ebe0-9760-4725-8149-bdb2b80c12be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.234562 May 26 21:46:49.425702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1001/2011] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:49 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:50.427972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:50.428606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:50.435321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:50.435941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:50.436538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:50.436999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:50.442456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:50.443075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:50.449687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:50.450395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:50.451173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:50.451616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:50.640372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:50.648623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fc875b8b-a3a7-41d1-9f39-2d7fce800b6e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224372 May 26 21:46:50.649293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1011/2012] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:50.651774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:50.659982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-797142d9-72e9-4321-9265-c376952d49cc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221829 May 26 21:46:50.660592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1002/2013] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:51.665905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:51.666482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:51.668891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:51.674001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:51.674458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:51.675238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:51.675679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:51.676961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:51.680152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:51.684162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:51.684639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:51.685420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:51.685857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:51.877816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:51.882535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:51.886682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dad2e963-11c0-4ee2-8d75-f29481c713e4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224697 May 26 21:46:51.887343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1012/2014] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:51 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:51.890937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d97abd4-8bd3-44b0-95be-55663c5ab6e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217885 May 26 21:46:51.895366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1003/2015] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:52.904592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:52.905233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:52.907560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:52.908257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:52.912089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:52.912542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:52.913343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:52.913782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:52.914913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:52.915371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:52.916204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:52.916673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:53.117621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:53.117867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:53.128782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f41c82a7-758d-4b94-b326-4f0d277d7e04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224533 May 26 21:46:53.129523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1004/2016] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:53.131738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17c45dad-41bf-4e35-8689-ece57aa9f88d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.230868 May 26 21:46:53.132357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1013/2017] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:54.147399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:54.148029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:54.150433 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:54.151637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:54.155258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:54.155719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:54.156492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:54.156959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:54.160539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:54.161222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:54.162478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:54.162869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:54.181119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:46:54.367409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:54.373248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:54.381244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-863d9c6e-d191-42e9-855b-0d8eee3d34b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.235443 May 26 21:46:54.382199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1014/2018] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:54 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:54.388421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e0dc5c61-30dc-40a6-bced-966e0fe712a0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.245693 May 26 21:46:54.389507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1005/2019] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:55.402180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:55.402793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:55.405841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:55.406462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:55.409905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:55.410355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:55.412082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:55.412215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:55.413790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:55.414081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:55.414841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:55.415280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:55.609595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:55.618988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9742c0ff-4e94-41d0-90a3-8d7521a193f5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220713 May 26 21:46:55.619145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:55.619562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1015/2020] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:55 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:55.627454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1f3781cd-5ee3-46c1-bca2-49007c79985a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225601 May 26 21:46:55.628024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1006/2021] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:55 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:56.636623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:56.637240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:56.644418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:56.645013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:56.645337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:56.645773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:56.646021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:56.646191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:56.652484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:56.652984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:56.653765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:56.654201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:56.846009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:56.854332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:56.856017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5312242d-8a5d-4efc-b292-6ba8d32810c3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223335 May 26 21:46:56.856813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1016/2022] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:56 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:56.864047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3ee8300-ac01-4ba3-a0a6-6f26d76da5bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223100 May 26 21:46:56.866233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1007/2023] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:57.883325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:57.884039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:57.887507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:57.888558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:57.891303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:57.891763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:57.893157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:57.893607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:57.896727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:57.897176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:57.897984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:57.898422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:58.090311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:58.093939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:58.103729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-620c37bf-8f5a-4b9a-8cec-2dc4aa08ea98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225833 May 26 21:46:58.109889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1017/2024] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:58.110048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d43d8fce-cb89-41f0-b835-09700325414f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.231043 May 26 21:46:58.110048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1008/2025] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:46:59.123110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:59.123741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:59.127095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:46:59.127584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:46:59.131459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:59.131920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:59.132729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:59.133258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:59.134613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:59.135075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:59.143405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:46:59.143405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:46:59.334103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:59.338765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:46:59.342401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6e65b705-17d2-4941-a853-7ddbadc4e44d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223175 May 26 21:46:59.342990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1018/2026] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:59 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:46:59.347388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-29316b12-3ce2-4c38-9e08-19f4d6925f7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224709 May 26 21:46:59.347958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1009/2027] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:46:59 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:00.359541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:00.360172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:00.364109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:00.364754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:00.367185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:00.367703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:00.368609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:00.369089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:00.372225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:00.372734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:00.373531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:00.373977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:00.569374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:00.578270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9c4645ff-8019-49cf-b054-846559f528d7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222492 May 26 21:47:00.579601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1019/2028] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:00 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:00.585286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:00.593524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-56d74869-8d6d-4e20-9641-87977ce02dfc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.233168 May 26 21:47:00.594095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1010/2029] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:01.595964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:01.596622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:01.603051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:01.603495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:01.604249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:01.604711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:01.611621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:01.612246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:01.614654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:01.619658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:01.620192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:01.621035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:01.621598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:01.816950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:01.821070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:01.827175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2656f141-a63a-4bb7-b3f4-e486c4d7c861 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.235548 May 26 21:47:01.827836 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1020/2030] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:01 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:01.829228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-57bca74e-1d54-48c4-a1c8-a8f16371b23f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221958 May 26 21:47:01.830319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1011/2031] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:01 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:02.847170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:02.847775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:02.847910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:02.848492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:02.855462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:02.855919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:02.856650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:02.856773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:02.857109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:02.857239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:02.857882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:02.858324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:03.057297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:03.061410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:03.065301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-779c7026-e8a3-4ddf-9aed-aa5fdd10ea2f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221785 May 26 21:47:03.065883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1012/2032] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:03.069543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ab9afbe-e5f4-448e-93bf-30a419ad8915 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.226823 May 26 21:47:03.070120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1021/2033] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:04.083695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:04.084308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:04.086503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:04.087130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:04.090881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:04.091327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:04.092090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:04.092522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:04.093562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:04.094018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:04.094788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:04.095849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:04.289432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:04.292811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:04.297659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e99b27a5-1dfb-4cb7-b7ea-8ff41fe96c48 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218387 May 26 21:47:04.298301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1013/2034] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:04.301240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-af6abd02-7c8e-4219-8658-346f967af99c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218597 May 26 21:47:04.301881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1022/2035] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:04 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:05.314391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:05.315066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:05.318034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:05.318656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:05.321827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:05.322284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:05.323050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:05.323499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:05.325074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:05.325531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:05.326300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:05.326743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:05.517597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:05.525544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:05.532638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b22261a1-866d-4e34-a6a4-cd1cd0bc80c6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221835 May 26 21:47:05.533608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1014/2036] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:05 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:05.539229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b7f4c5ad-0b95-4167-96d0-66ac0066cd63 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224968 May 26 21:47:05.540009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1023/2037] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:05 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:06.549857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:06.550479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:06.557081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:06.557797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:06.558768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:06.559378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:06.561195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:06.561942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:06.569935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:06.570190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:06.571206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:06.571871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:06.576708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:06.759095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:06.766106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:06.767384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-68fbb233-4946-4bd5-8468-c0506d2d0b67 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221292 May 26 21:47:06.768133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1015/2038] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:06.774205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4b4384b-8f86-4a30-88e6-1d952130490c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220779 May 26 21:47:06.774769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1024/2039] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:06 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:07.784946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:07.785574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:07.791569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:07.792230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:07.792390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:07.792953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:07.793601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:07.794045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:07.798491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:07.798930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:07.799712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:07.800153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:08.238972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:08.242004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:08.247158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bea508ac-2cd6-4606-84d0-3372e28a07b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.466735 May 26 21:47:08.247941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1016/2040] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:08.250245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2093b45e-1bf8-451e-bfc0-520db73ad339 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.462936 May 26 21:47:08.250807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1025/2041] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:07 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:09.265354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:09.265980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:09.266898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:09.267516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:09.272675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:09.273134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:09.273908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:09.274111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:09.274464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:09.274794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:09.275593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:09.276026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:09.472186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:09.481830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-56e44949-b7b9-4bce-abdf-c99383f25ac8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220407 May 26 21:47:09.483488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1017/2042] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:09 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:09.494253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:09.504004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e67c3edd-6fb4-4a3d-a97b-5c425d1c855f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.240758 May 26 21:47:09.504622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1026/2043] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:09 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:10.503190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:10.503887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:10.510341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:10.510787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:10.511553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:10.511989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:10.523046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:10.524178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:10.532009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:10.532739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:10.533752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:10.534394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:10.708827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:10.716931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2969de0e-2515-4401-9585-3dcf604224e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218250 May 26 21:47:10.717510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1018/2044] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:10.732482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:10.740527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-342a542e-b2a5-4303-8e60-7bc48f390dc1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221461 May 26 21:47:10.741378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1027/2045] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:10 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:11.734379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:11.734950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:11.741435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:11.741881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:11.742634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:11.743066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:11.757837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:11.758463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:11.764900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:11.765357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:11.766129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:11.767092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:11.938885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:11.945614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:11.947435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a12a53e2-8517-4cb9-ae04-1f0fc39c9102 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216941 May 26 21:47:11.948025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1019/2046] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:11.953955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4df1f3b2-94b8-4e25-8d3d-e5ce6331790d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.199878 May 26 21:47:11.955158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1028/2047] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:12.964822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:12.965428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:12.972369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:12.972954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:12.973173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:12.973321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:12.974052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:12.974498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:12.979406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:12.979865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:12.980667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:12.981108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:13.169754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:13.176809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:13.177761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-abf79af0-1f0d-46c5-8636-456e2ef3f952 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216810 May 26 21:47:13.178343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1020/2048] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:13.184847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ed105d76-7b79-4854-b975-cdeeed3708e8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217441 May 26 21:47:13.185558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1029/2049] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:14.195000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:14.195551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:14.201443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:14.202063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:14.202180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:14.202592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:14.203370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:14.203815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:14.208195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:14.208671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:14.209436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:14.209872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:14.401449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:14.404802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:14.410205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e43e6140-8aec-47f7-ac81-5a7cb447de00 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219135 May 26 21:47:14.410788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1021/2050] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:14.414286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bb2e2281-de4d-4625-b9ab-aee6b026540c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216572 May 26 21:47:14.414861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1030/2051] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:14 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:15.427963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:15.428610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:15.430713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:15.431340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:15.435397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:15.435849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:15.436643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:15.437084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:15.438096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:15.439136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:15.439948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:15.440363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:15.441870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:15.638930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:15.643377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:15.646995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1441cbc-f999-411a-960c-06a7e06b84b2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222934 May 26 21:47:15.647575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1022/2052] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:15 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:15.651405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-70ae5265-6b47-4008-a958-82bbdf458941 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224464 May 26 21:47:15.651963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1031/2053] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:16.664213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:16.665129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:16.668883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:16.669516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:16.671815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:16.672280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:16.673619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:16.674067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:16.676903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:16.677375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:16.678156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:16.678609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:16.873933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:16.878088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:16.884081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-08aabe90-05dd-4538-a2ca-06bf9ea2e08a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224014 May 26 21:47:16.884918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1023/2054] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:16 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:16.886465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b779eb56-425a-4988-b373-69e1aa259916 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221439 May 26 21:47:16.887033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1032/2055] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:17.903082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:17.903908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:17.908325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:17.908979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:17.916037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:17.916505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:17.917321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:17.917767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:17.927388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:17.927838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:17.928622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:17.929060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:18.115768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:18.123577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:18.124808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1631f755-2f16-4b40-9446-5425ced77b2c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220196 May 26 21:47:18.126436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1024/2056] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:18.133358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-069756e6-8a87-44f8-861b-1f21adcca318 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.234022 May 26 21:47:18.134013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1033/2057] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:17 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:19.142713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:19.143331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:19.149850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:19.150305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:19.151071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:19.151187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:19.151606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:19.151721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:19.157765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:19.158217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:19.158987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:19.159430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:19.354397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:19.358487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:19.363049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8808c4c2-f456-4805-9c32-812d24780a38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224171 May 26 21:47:19.363618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1025/2058] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:19.366924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dc21a070-f20d-4823-b9cb-1073ed3e04e1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219779 May 26 21:47:19.367498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1034/2059] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:20.380655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:20.381459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:20.383081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:20.384347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:20.388213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:20.388687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:20.389464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:20.389907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:20.391150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:20.391601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:20.392817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:20.393426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:20.586682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:20.590787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:20.596162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-93858afa-fe5b-4762-bf1a-0118df0b47e4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219692 May 26 21:47:20.596878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1026/2060] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:20 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:20.599607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-73afe3af-966f-4e8f-b33a-3abc1f27e487 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220159 May 26 21:47:20.600252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1035/2061] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:20 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:21.614846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:21.615477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:21.617004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:21.617620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:21.622356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:21.622822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:21.623606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:21.624051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:21.624171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:21.624519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:21.625323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:21.625762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:21.817893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:21.822007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:21.826066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1a76ff81-f2a2-4612-b9e4-b1c7b495d238 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215849 May 26 21:47:21.826654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1027/2062] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:21.829961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-32118acd-7271-4d9d-a3ab-0b77d7961e4a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216925 May 26 21:47:21.830520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1036/2063] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:22.843212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:22.843961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:22.847272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:22.847888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:22.850234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:22.851259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:22.851710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:22.852478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:22.852950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:22.855099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:22.855551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:22.856317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:22.856791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:23.051846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:23.055907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:23.060221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aa83d5d0-f92d-4832-922a-fdbe2df84a79 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221087 May 26 21:47:23.060946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1028/2064] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:22 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:23.064647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fcf80686-f814-46c6-a9bc-1851385b84e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221677 May 26 21:47:23.065223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1037/2065] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:24.078597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:24.079236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:24.084145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:24.085181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:24.087013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:24.087474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:24.088282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:24.089124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:24.094410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:24.094868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:24.095713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:24.096153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:24.289012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:24.291728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:24.297210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8294c94b-1a55-4cd8-8b4e-905a69f56e83 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222573 May 26 21:47:24.297793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1029/2066] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:24.300453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37d931b5-7a3a-4ea4-91f0-8589979f5b4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222510 May 26 21:47:24.301053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1038/2067] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:25.315137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:25.315755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:25.316718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:25.317342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:25.322354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:25.322801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:25.323577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:25.323780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:25.324019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:25.324246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:25.325055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:25.325494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:25.525797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:25.533867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:25.542262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fe09a58d-d19b-414b-b1f7-c651de2cb5fa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.231106 May 26 21:47:25.542888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1030/2068] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:25 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:25.543851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ec3adcf4-78e4-4c06-af3d-ede17c04606a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.230929 May 26 21:47:25.550179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1039/2069] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:25 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:26.566462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:26.566462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:26.567044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:26.567044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:26.578286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:26.579068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:26.580831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:26.580978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:26.581565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:26.581702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:26.582849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:26.583582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:26.794450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:26.797398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:26.801478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:26.804131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-435e314f-437d-4ef3-b9a6-11b2b72475d8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.245333 May 26 21:47:26.804965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1031/2070] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:26.806920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-56a07bee-6190-49cb-ae31-9cfebf7f275d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.248486 May 26 21:47:26.807486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1040/2071] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:26 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:27.820616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:27.821251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:27.826979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:27.827598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:27.827777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:27.828236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:27.829046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:27.829492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:27.834488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:27.834938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:27.835700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:27.836133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:28.025602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:28.029413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:28.034389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c74f17c8-a8f3-494a-904e-43b3975ea2bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217599 May 26 21:47:28.034969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1032/2072] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:28.038155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-65968f47-952d-4088-a5da-84b9fd2fe4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214891 May 26 21:47:28.038727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1041/2073] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:29.052003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:29.052650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:29.055842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:29.056466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:29.059770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:29.060240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:29.061054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:29.061727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:29.063248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:29.063709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:29.065190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:29.065677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:29.264462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:29.268480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:29.273258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-029fdbd9-b3d9-44c6-af74-2ba006e0d62b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225737 May 26 21:47:29.273840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1033/2074] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:29.277285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ee26e5d7-cd61-4c02-8214-a87aea29eed4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225371 May 26 21:47:29.277857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1042/2075] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:29 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:30.291335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:30.291961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:30.294547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:30.295157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:30.298732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:30.299197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:30.299969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:30.300411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:30.301551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:30.302002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:30.302761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:30.303193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:30.500742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:30.505298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:30.509670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-54f87a88-74b0-4861-a91d-dfa729333294 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222132 May 26 21:47:30.510270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1034/2076] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:30.513833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c36cf64f-107f-4ca2-bb67-8d0a53b4d84c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223023 May 26 21:47:30.514406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1043/2077] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:31.527671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:31.528281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:31.531755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:31.532384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:31.534955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:31.535412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:31.536191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:31.536658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:31.539293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:31.539748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:31.540525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:31.540997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:31.741954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:31.746356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:31.750501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cccda3a1-e983-4578-bc33-1086ace7e571 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227047 May 26 21:47:31.751104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1035/2078] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:31 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:31.755017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f0489b01-0807-44e4-aa6b-fce5da4bde6c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227019 May 26 21:47:31.755592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1044/2079] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:31 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:32.768363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:32.769011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:32.771348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:32.772565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:32.773369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:32.776677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:32.777134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:32.777915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:32.778351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:32.779875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:32.780327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:32.781138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:32.781581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:32.982030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:32.992012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ef468fa3-2ca7-4f23-a8af-ecb6856afc97 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227463 May 26 21:47:33.001676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1036/2080] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:33.002454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:33.014233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6e0b9dfc-13a2-44e0-9b88-735e31b2c302 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.244763 May 26 21:47:33.024846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1045/2081] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:34.009809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:34.010551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:34.017416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.018149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.019457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.019911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.042910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:34.044283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:34.055537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.056096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.057303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:34.057916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:34.240647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:34.248783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9a4f205d-cbed-4130-9267-2a702f40cb38 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.243302 May 26 21:47:34.249671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1037/2082] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:34 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:34.264761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:34.273360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84b9d96b-15a4-41ec-b902-5b01ea91d4be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.238827 May 26 21:47:34.274044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1046/2083] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:35.267452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:35.268134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:35.274863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.275331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.276111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.276558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.290391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:35.291131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:35.297738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.298194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.298964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:35.299494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:35.482134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:35.484395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:35.491240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f07019ef-bbc7-4947-981e-47ea7c3d8601 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227644 May 26 21:47:35.498255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1038/2084] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:35 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:35.499713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:35.508712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-433b01b6-da66-4967-8c24-ae5aed9175e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222208 May 26 21:47:35.509293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1047/2085] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:35 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:36.508075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:36.508728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:36.515718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.516163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:36.517038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.517471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:36.527256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:36.527937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:36.535607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.536054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:36.536870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:36.537306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:36.714090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:36.722912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-06160739-46bc-4ea7-852a-7e489d1be355 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219034 May 26 21:47:36.723503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1039/2086] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:36.736291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:36.745167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-394ab170-9f15-4a53-830f-6d1628fe0dd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221679 May 26 21:47:36.746787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1048/2087] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:36 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:37.739913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:37.740545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:37.747116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:37.747573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.748382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:37.748866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.764059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:37.764691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:37.771399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:37.771856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.772647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:37.773087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:37.948353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:37.956936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:37.957616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-10b004b1-4b73-4106-b50a-1966b611e7c4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222041 May 26 21:47:37.958219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1040/2088] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:37.975011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d4ae21dc-0089-476a-abb3-8da83633acad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214809 May 26 21:47:37.975592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1049/2089] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:38.975037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:38.975610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:38.982280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:38.982747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:38.983518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:38.983969 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:38.991178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:38.991833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:38.998181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:38.999304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:39.000247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:39.000738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:39.188712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:39.193640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:39.197205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f97a524b-5acd-4eef-8854-330ff6d9eebc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226209 May 26 21:47:39.197781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1041/2090] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:39.201590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5eb9891d-9fa1-4be4-b274-4ab5ecaf743c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214428 May 26 21:47:39.202167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1050/2091] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:40.214562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:40.215398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:40.218207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:40.218822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:40.222698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.223151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.223925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.224374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.225579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.226024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.226779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:40.227213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:40.424790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:40.431165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:40.433088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6927c2fb-72d7-45af-b50d-54e0e1358132 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222333 May 26 21:47:40.433665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1042/2092] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:40.439406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-41c18451-2b55-43cf-b505-709241595f98 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224863 May 26 21:47:40.439967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1051/2093] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:40 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:41.450518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:41.451185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:41.457429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:41.458743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.459200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.459507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:41.460094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.460386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.466927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.467861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.468672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:41.469119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:41.576476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:47:41.577108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 (ip 10.222.0.66) !!! May 26 21:47:41.657117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:41.660457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:41.665442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9db7ba9e-14b7-42f8-bdce-e341cc9b2e13 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218780 May 26 21:47:41.666030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1043/2094] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:41 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:41.669099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc7e42bf-22e9-49bb-8a49-6a0a3613e465 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215832 May 26 21:47:41.675555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1052/2095] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:42.683435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:42.684008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:42.686816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:42.687441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:42.690358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.690817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:42.691592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.692035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:42.694056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.694511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:42.695274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:42.695712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:42.883892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:42.892174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-423fa4c6-0c5c-4a20-b682-aa1010c83c3c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.212885 May 26 21:47:42.892983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1044/2096] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:42.901561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:42.909907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6d75e1f1-6ba3-40ef-b1c6-238b8dbbcc37 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.226815 May 26 21:47:42.910493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1053/2097] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:43.910207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:43.910809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:43.917534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:43.917992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:43.918769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:43.919215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:43.926741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:43.927360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:43.933530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:43.934008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:43.934778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:43.935216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:44.120439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:44.123621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:44.129802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e62074f7-6a47-40f3-bc98-cbe456244610 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224110 May 26 21:47:44.130395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1045/2098] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:43 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:44.132901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-82500107-925b-40d6-b78c-ea01b6610b7c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209700 May 26 21:47:44.133481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1054/2099] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:45.147396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:45.147975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:45.151994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:45.152635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:45.154636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.155093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.155949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.156407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.159443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.159893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.160698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:45.161189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:45.372901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:45.386514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f627a95f-8e00-4bdb-a88d-8bf144506555 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.242728 May 26 21:47:45.387585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1046/2100] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:45.387770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:45.397750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1bd1d3d2-09d9-421c-898e-ff4807efc0e2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.249361 May 26 21:47:45.398556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1055/2101] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:46.411286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:46.411907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:46.418485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.418965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.420011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.420464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.426059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:46.426685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:46.433372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.433819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.434585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:46.435019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:46.879390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:46.883569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:46.887452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-340deb3e-a146-4e5e-bc19-1e3f397c82d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.480521 May 26 21:47:46.888053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1047/2102] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:46 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:46.891582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5f1d5862-178a-481c-9980-f0bb5b9019be tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.470227 May 26 21:47:46.892347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1056/2103] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:46 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:47.903832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:47.904456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:47.908469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:47.909248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:47.911084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.911537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.912341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.912808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.915790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.916288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.917101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:47.917573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:47.935972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:48.114366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:48.117425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:48.122742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7fd64ffb-0db4-4966-aaf3-781ad4cdeb0c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222672 May 26 21:47:48.123362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1048/2104] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:48.127121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-070437f5-af53-4513-bc67-501d8d325ce0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222226 May 26 21:47:48.128322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1057/2105] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:49.141155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:49.141695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:49.144977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:49.145595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:49.148816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.149266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.150028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.150466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.151688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.152143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.152929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:49.153363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:49.351826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:49.354894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:49.360715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bb8db5ff-24b4-4ef7-94ff-1a636317f477 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219950 May 26 21:47:49.361313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1058/2106] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:49.363194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d7ba5ff7-7757-47ed-93b5-3201f20b7419 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226178 May 26 21:47:49.363775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1049/2107] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:49 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:50.379241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:50.379951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:50.380372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:50.380489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:50.386428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.386624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.386876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.386998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.387642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.387756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:50.388079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.388191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:50.586624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:50.591329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:50.595069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8ad39b8f-f46e-4b77-a7f8-a3e2c0f3f6ea tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219742 May 26 21:47:50.595648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1050/2108] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:50.599863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-350ffc61-74af-4af0-8d6d-16d94dbeef65 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224663 May 26 21:47:50.600608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1059/2109] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:51.613165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:51.613787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:51.617787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:51.618437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:51.620840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.621305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.622123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.622560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.624502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.624976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.625731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:51.626166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:51.819350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:51.822133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:51.827525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8159bdf2-cbbb-4954-b77f-e19236fd4a10 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.213958 May 26 21:47:51.828107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1060/2110] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:51 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:51.831293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9ea406e1-1624-4107-a2df-5a1ba9f78eef tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222794 May 26 21:47:51.831872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1051/2111] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:52.844693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:52.845291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:52.848943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:52.849574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:52.852417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:52.852901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:52.853927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:52.854376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:52.856304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:52.856830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:52.857616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:52.858069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:53.062707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:53.064701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:53.072896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-498d454c-f226-4575-a82b-f9decc9f27d2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.231897 May 26 21:47:53.073597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1061/2112] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:53.074077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ad7981ee-0fc2-42ad-a1c9-159f5d2637d5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.229466 May 26 21:47:53.074766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1052/2113] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:54.091215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:54.091867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:54.092272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:54.092570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:54.095755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:54.098634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:54.099098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:54.099885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:54.100341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:54.101218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:54.101678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:54.103181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:54.103626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:54.307514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:54.310791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:54.315906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2b63679e-c96a-4452-9b1e-b6cc75dd0678 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228473 May 26 21:47:54.316497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1053/2114] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:54.324031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eb69b333-e704-46d6-bac8-d6b6bbfce6bb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.236611 May 26 21:47:54.324873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1062/2115] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:54 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:55.334581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:55.335292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:55.341490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:55.342254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:55.342372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:55.342473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:55.343148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:55.343598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:55.349450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:55.349899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:55.350670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:55.351111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:55.550251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:55.559048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-80e62681-f3a5-4581-ac12-2f7fa1df1d5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.229105 May 26 21:47:55.561793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1054/2116] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:55 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:55.562750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:55.569980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dc0a3746-85f7-4d2d-970c-b2ef9327e036 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.232339 May 26 21:47:55.570557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1063/2117] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:55 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:56.578260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:56.578879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:56.586065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:56.586520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:56.587296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:56.587735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:56.588342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:56.589025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:56.596081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:56.597010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:56.597784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:56.598229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:56.603426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:47:56.784696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:56.787434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:56.792989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ccb87069-43b1-4879-b95c-c7c77955d4a2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218585 May 26 21:47:56.793658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1055/2118] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:56.795381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eebe8ce0-df78-48d2-83b8-69615e392b8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.211756 May 26 21:47:56.795945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1064/2119] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:56 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:57.809824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:57.810468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:57.811360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:57.812278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:57.817426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:57.817867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:57.818637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:57.819071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:57.819378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:57.819831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:57.820623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:57.821065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:58.023156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:58.026393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:58.034792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-85568f90-223a-4837-a68d-5d8e3387b4ee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227149 May 26 21:47:58.035380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1065/2120] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:58.035519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-580a8944-c3f7-4e61-92f8-4a99b1b4136d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.229363 May 26 21:47:58.036169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1056/2121] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:47:58.844663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:47:58.845243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:47:59.053668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:59.054300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:59.055049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:47:59.055678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:47:59.061463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:59.061923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:59.062238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:59.062731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:59.062860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:59.063135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:59.063610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:47:59.064061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:47:59.262341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:59.265507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:47:59.271040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9d4f9148-adaa-4ba9-9ea3-e556b37f93a4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219708 May 26 21:47:59.271627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1057/2122] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:59 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:47:59.273368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6435310a-3d98-46a0-a22a-18de05bd6b45 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224561 May 26 21:47:59.273927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1066/2123] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:47:59 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:00.288460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:00.289111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:00.290172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:00.290792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:00.295543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:00.295998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:00.296811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:00.297246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:00.297422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:00.297702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:00.298470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:00.298908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:00.504452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:00.506581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:00.513306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-217ca3b7-6c86-42a8-b80f-b42846465bbc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.228857 May 26 21:48:00.513907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1058/2124] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:00 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:00.515171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15ecac6b-4818-4b33-b5de-8831036b139d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228817 May 26 21:48:00.515725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1067/2125] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:01.530904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:01.532164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:01.532628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:01.533325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:01.539139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:01.539679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:01.540045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:01.540494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:01.540862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:01.541568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:01.541662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:01.541899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:01.742892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:01.746077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:01.751022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e9bc4bc3-df75-4916-99be-43c5012f1e58 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224108 May 26 21:48:01.751875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1059/2126] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:01 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:01.755161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3d5d59d6-9351-48cd-8483-5d3d9fc48dd8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226329 May 26 21:48:01.755755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1068/2127] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:01 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:02.769818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:02.770513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:02.771517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:02.772128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:02.777154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:02.777607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:02.778268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:02.778416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:02.778713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:02.778824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:02.779463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:02.779891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:02.971391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:02.974653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:02.979559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-44b40ad9-b6f9-4e20-bd3c-f986ca71fcac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214374 May 26 21:48:02.980230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1060/2128] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:02.982808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9589d0d4-a961-4eb7-abd3-280077e4c841 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215632 May 26 21:48:02.983367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1069/2129] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:03.997734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:03.998361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:03.999014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:03.999639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:04.000775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:04.006014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:04.006421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:04.006557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:04.007033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:04.007231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:04.007673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:04.007800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:04.008227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:04.197150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:04.204131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:04.206077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-29881a74-ca08-4f6a-8868-c313322bdb04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.210212 May 26 21:48:04.206667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1070/2130] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:03 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:04.212701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9f19045a-5f56-4e09-be71-c35d3b40eea8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219450 May 26 21:48:04.213273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1061/2131] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:03 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:05.224109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:05.224762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:05.230243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:05.235411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:05.235547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:05.235547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:05.235547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:05.235547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:05.238031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:05.238487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:05.239286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:05.239723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:05.427182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:05.433952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:05.435878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c3064b39-cc42-4e4f-ae3b-9b92711f0ca5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216645 May 26 21:48:05.436514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1071/2132] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:05 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:05.442367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-41f798a7-c43e-4a3b-b872-d4cdd465ddb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215961 May 26 21:48:05.443092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1062/2133] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:05 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:06.459130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:06.459723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:06.466492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:06.466968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:06.467922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:06.468165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:06.561752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:06.562944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:06.569437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:06.570440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:06.570862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:06.571303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:06.609920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:06.618802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f77c13ca-655d-41bf-b18e-2459975b4204 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.163497 May 26 21:48:06.619385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1063/2134] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:06 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:06.704992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:06.713429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-29c0a68f-177e-4224-851c-24c8268560c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.264120 May 26 21:48:06.714189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1072/2135] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:07.635117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:07.635734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:07.642166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:07.642670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:07.643424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:07.643857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:07.730830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:07.731467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:07.738928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:07.739397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:07.740368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:07.740838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:07.779420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:07.787695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae1a298a-bb34-4701-95e8-7d51776acfb7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.156371 May 26 21:48:07.788385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1064/2136] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:07 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:07.872392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:07.881379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bd07085b-3b30-4028-b5cc-3c587d74341c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154361 May 26 21:48:07.881933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1073/2137] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:08.805377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:08.805988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:08.812631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:08.813030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:08.813782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:08.814217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:08.897765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:08.898390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:08.905118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:08.905575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:08.906348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:08.906791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:08.911968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:08.960592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:08.968905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a4e6b54e-f3f5-45eb-8b9a-1bc1e29739e7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.167334 May 26 21:48:08.969498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1065/2138] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:08 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:09.051930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:09.060067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-00c03602-e7d0-4ed3-a1b7-bda5e6acf24c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.166186 May 26 21:48:09.060663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1074/2139] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:08 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:09.986273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:09.986862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:09.993444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:09.993897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:09.994661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:09.995106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:10.077778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:10.078385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:10.087170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:10.087616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:10.088381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:10.088842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:10.147558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:10.155638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3a9246cd-a31b-4ebe-a85a-504f274ecf42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.173316 May 26 21:48:10.156221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1066/2140] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:09 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:10.238519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:10.246386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fe50bf98-e3a6-4cf9-8857-7e6dc67eea6c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.172726 May 26 21:48:10.246948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1075/2141] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:11.173417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:11.174682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:11.181266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:11.183300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:11.183300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:11.183300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:11.264624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:11.265189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:11.272293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:11.272849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:11.273626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:11.274063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:11.326010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:11.334429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-74b8997f-4ab9-4293-b157-28c0c5e34330 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.164852 May 26 21:48:11.335014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1067/2142] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:11.414475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:11.422718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-06253c81-0780-496f-89ad-aa3a79e0dde3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.162270 May 26 21:48:11.423295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1076/2143] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:12.351904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:12.352538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:12.359071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:12.359524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:12.360291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:12.360776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:12.440125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:12.441119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:12.448085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:12.448617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:12.449396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:12.449841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:12.502423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:12.511111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d5fa356-ad6c-4fe8-a0ab-dda98c3b4a07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.163360 May 26 21:48:12.511699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1068/2144] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:12.585441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:12.593637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5239fafd-ac4a-4dbe-93b9-27dbb3ed0d04 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.158204 May 26 21:48:12.594287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1077/2145] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:13.528364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:13.529020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:13.536281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:13.536791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:13.537542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:13.538054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:13.611994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:13.612734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:13.619792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:13.620259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:13.621084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:13.621555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:13.704170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:13.713138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a10d557d-3c30-4409-8b92-f7c707822040 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.188725 May 26 21:48:13.714132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1069/2146] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:13.763798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:13.772414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f24292ee-03c6-43dd-b3e3-cd4b6e627da1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.164932 May 26 21:48:13.773016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1078/2147] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:14.730214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:14.730868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:14.738060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:14.738511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:14.739271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:14.739707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:14.790047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:14.790762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:14.797541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:14.797989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:14.799379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:14.799810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:14.910831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:14.918932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3eb02071-bae5-4bee-bb38-e2db6ead24cc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.192487 May 26 21:48:14.919505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1070/2148] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:14 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:14.955977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:14.964103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-687beb1c-77ec-47f8-a117-c06ccfa7bada tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.177981 May 26 21:48:14.964705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1079/2149] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:15.938701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:15.939912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:15.946416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:15.946859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:15.947608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:15.948039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:15.981942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:15.982568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:15.989750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:15.990212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:15.990987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:15.991430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:16.128146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:16.136083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-583ec40a-3bd0-4f42-8160-95184c906e32 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.202689 May 26 21:48:16.136675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1071/2150] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:16.154185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:16.162143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d11c085e-8abe-4b56-95cd-eb265f9efb70 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.184048 May 26 21:48:16.162714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1080/2151] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:15 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:17.153571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:17.154195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:17.161123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:17.161579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:17.162351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:17.162795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:17.166701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:17.178925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:17.183841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:17.186136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:17.186583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:17.187344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:17.187774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:17.607370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:17.616237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8f45b0fc-9f5e-4abc-966e-d71a43dafed0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.466678 May 26 21:48:17.617029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1072/2152] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:17 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:17.630147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:17.638096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-76c5f79c-dd63-4de1-87e9-8d483ffd5a33 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.463049 May 26 21:48:17.638664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1081/2153] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:18.633722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:18.634320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:18.640868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:18.646124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:18.646124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:18.646124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:18.654038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:18.654657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:18.661769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:18.662247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:18.663021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:18.663460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:18.826851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:18.834986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-02ecf8c3-ad29-4af9-a602-4723c3ef4f74 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.205171 May 26 21:48:18.835563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1073/2154] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:18.847997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:18.856022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33a0c9b2-ad9c-491b-842b-64e03028fbf2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.205889 May 26 21:48:18.856597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1082/2155] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:18 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:19.851731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:19.852361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:19.858971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:19.859430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:19.860192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:19.861200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:19.873327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:19.873946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:19.882128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:19.882608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:19.883434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:19.883876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:20.053654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:20.060243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:20.061841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-751292cf-2747-40eb-a0bf-eb26d718adb1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.213976 May 26 21:48:20.062433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1074/2156] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:20.068992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ea0a4fd2-7bb1-4ffd-a990-cd1b7aee1b29 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.199385 May 26 21:48:20.069567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1083/2157] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:21.079234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:21.081841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:21.086888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:21.087488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:21.087629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:21.087946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:21.088759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:21.089205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:21.093993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:21.094675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:21.095449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:21.095906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:21.291076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:21.295544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:21.297065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-561ceaea-91ae-4dc9-b62f-7efd35d464eb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221617 May 26 21:48:21.300617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1075/2158] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:21.304789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bde7b496-b20c-413a-becb-9409e93cd27e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221717 May 26 21:48:21.305360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1084/2159] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:22.321516 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:22.322385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:22.328799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:22.329253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:22.330032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:22.331176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:22.471591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:22.474267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:22.474894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:22.480633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-668bc03e-5ddf-4fca-b397-a04d3bc1e993 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.162897 May 26 21:48:22.481043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:22.481362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1085/2160] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:22 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:22.481502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:22.482361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:22.482867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:22.613717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:22.621842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-143ff9db-c2d8-48cf-a12c-7dc4c5e3eba4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.310742 May 26 21:48:22.622413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1076/2161] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:23.498718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:23.499335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:23.506154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:23.506608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:23.507376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:23.507819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:23.639373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:23.639903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:23.640043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:23.647184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:23.647582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:23.648130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d5e8469e-5342-422b-8f01-057e9a9128b5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153293 May 26 21:48:23.648359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:23.648735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1086/2162] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:23.648905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:23.784189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:23.787746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ce2122cc-f41f-4ffa-8df5-c1a4df650b8c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152289 May 26 21:48:23.788324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1077/2163] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:23 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:24.665207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:24.665207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:24.668261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:24.673169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:24.678085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:24.678085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:24.678085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:24.806075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:24.806898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:24.807376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:24.813645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:24.822716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:24.822716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:24.822716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:24.823576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9ced8e69-37ca-4e16-bfe2-54bd248e4724 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154657 May 26 21:48:24.825822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1087/2164] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:24.951281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:24.959954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a3850f44-9c3f-4228-a1c6-48df5cf11256 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.158411 May 26 21:48:24.960632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1078/2165] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:25.832805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:25.833428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:25.839780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:25.840236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:25.841032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:25.841480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:25.968327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:25.977094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ca194b76-a694-4a02-9399-7b48bc33f5ce tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.148096 May 26 21:48:25.977825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1088/2166] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:25 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:25.977961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:25.978420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:25.984745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:25.985207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:25.986021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:25.987041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:26.118728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:26.126988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1081d5aa-6e87-41df-be65-2c98471335d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153122 May 26 21:48:26.127586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1079/2167] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:25 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:26.994560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:26.995177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:27.002445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:27.002889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:27.003731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:27.004076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:27.132707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:27.140749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-66daf08b-b462-4268-8e31-06fbb1b1232e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149928 May 26 21:48:27.151389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1089/2168] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:27.151579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:27.151579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:27.151579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:27.151579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:27.152337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:27.152439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:27.284867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:27.292687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-01bccd65-d831-4a66-8730-ef6b90e32c78 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152693 May 26 21:48:27.293250 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1080/2169] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:28.159350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:28.159978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:28.166521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:28.166979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:28.167748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:28.168191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:28.296985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:28.307670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:28.307670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6d489689-b4e3-4d1c-b255-a5f2964ed00d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.150275 May 26 21:48:28.307670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1090/2170] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:28 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:28.310069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:28.310697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:28.317701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:28.318152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:28.318915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:28.319350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:28.445830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:28.453645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7bc43227-50c1-4f4f-acfb-36febfd082a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.147697 May 26 21:48:28.454209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1081/2171] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:28 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:29.323289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:29.323897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:29.331048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:29.331515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:29.332261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:29.332721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:29.463794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:29.471814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:29.474874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:29.475025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-128e3f43-e737-4c31-92db-c3af357acd63 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153447 May 26 21:48:29.475025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1091/2172] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:29.479332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:29.479790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:29.480780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:29.481027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:29.613340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:29.621340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c5da43e4-50d0-4045-a73f-533b28fee9a1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.154018 May 26 21:48:29.621911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1082/2173] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:29 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:30.489858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:30.490486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:30.497138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:30.497594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:30.498358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:30.498800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:30.633374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:30.639194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:30.639823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:30.641813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-40a7c138-0601-48be-a5c5-07c0dabcc7b1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155930 May 26 21:48:30.642388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1092/2174] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:30.646787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:30.647249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:30.648028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:30.648478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:30.779143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:30.787690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-944d5df2-5aa7-4b14-8f91-7e6da54e2c5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152273 May 26 21:48:30.788525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1083/2175] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:31.658887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:31.660259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:31.666989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:31.667446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:31.668217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:31.668686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:31.795850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:31.804377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e87c5f32-f7e8-4b9a-b1eb-352d92403e32 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149424 May 26 21:48:31.804975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1093/2176] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:31 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:31.805336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:31.806036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:31.812673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:31.813135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:31.813907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:31.814358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:31.946949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:31.954813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-87253bb8-d269-46e0-a477-50c8e3865042 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153438 May 26 21:48:31.955388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1084/2177] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:31 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:32.821369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:32.821974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:32.828983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:32.829444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:32.830209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:32.830648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:32.960916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:32.968932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3e3f6e26-aa2a-4c6d-bd33-3b9987424ee3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.151415 May 26 21:48:32.969501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1094/2178] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:32.971260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:32.972397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:32.978925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:32.979381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:32.980147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:32.980607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:33.112882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:33.120854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-01893273-1389-4183-a4e2-68fa4bdb5eee tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153390 May 26 21:48:33.121428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1085/2179] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:33.986333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:33.986973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:33.994119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:33.994564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:33.995314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:33.995745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:34.122806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:34.131556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6f709778-25c0-4409-a4a4-24e78901b431 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149029 May 26 21:48:34.132130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1095/2180] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:33 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:34.138568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:34.139198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:34.141573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:34.146353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:34.146817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:34.147582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:34.148023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:34.283855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:34.292600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-99970aeb-19bb-4fb0-93b6-731420e7109d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157753 May 26 21:48:34.293166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1086/2181] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:35.148352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:35.148994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:35.155514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:35.155973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:35.156768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:35.157209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:35.286782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:35.298894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-567622d2-4f9a-4c0d-9869-9202fca3edf6 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154001 May 26 21:48:35.300544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1096/2182] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:35 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:35.309505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:35.310137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:35.317213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:35.317702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:35.318478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:35.318922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:35.511634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:35.519742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-be4b32de-ae2d-4e07-ba5e-bf536c334dd0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.213972 May 26 21:48:35.520458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1087/2183] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:35 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:36.317865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:36.318405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:36.325076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:36.325524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:36.326280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:36.326708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:36.460144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:36.468205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dcf7a3a0-95c5-4ad8-a50c-9e0111343142 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154864 May 26 21:48:36.468809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1097/2184] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:36 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:36.537378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:36.538012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:36.544278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:36.544792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:36.545573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:36.546018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:36.683392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:36.685652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:36.692201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-670bd63d-77d7-44d1-9b4f-3ed3240ae0f4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.158596 May 26 21:48:36.692822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1088/2185] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:36 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:37.485333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:37.486417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:37.493067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:37.493647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:37.494400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:37.494831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:37.633451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:37.641504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ad35e8ad-a24b-4ef0-a2d0-b6155b3862d1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.159971 May 26 21:48:37.642074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1098/2186] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:37.714880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:37.715460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:37.722741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:37.723192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:37.723954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:37.724395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:37.851332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:37.859235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2788d4ba-9720-4add-88b2-b477a07b0ff2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.148683 May 26 21:48:37.859802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1089/2187] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:38.660098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:38.661155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:38.668773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:38.668773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:38.668773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:38.669148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:38.802652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:38.810682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84ee2d3d-4fa4-4936-9c93-aa5135915d78 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155687 May 26 21:48:38.811257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1099/2188] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:38.876377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:38.877048 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:38.883677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:38.884125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:38.884925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:38.885359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:39.012565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:39.020421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c1315051-a742-4a72-a7dd-13ba2965a5da tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.148175 May 26 21:48:39.021017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1090/2189] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:39.828397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:39.829051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:39.835981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:39.836431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:39.837223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:39.837656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:39.967446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:39.975953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-20094abb-a951-4628-978f-8a65ccffcaed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.151360 May 26 21:48:39.976525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1100/2190] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:39 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:40.038066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:40.038690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:40.045399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:40.045855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:40.046628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:40.047070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:40.177842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:40.185897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9027bea1-9eb9-4eba-9d39-56bd932c1401 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152289 May 26 21:48:40.186471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1091/2191] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:40 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:40.992555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:40.993188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:40.999693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:41.000405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:41.001189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:41.001623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:41.129936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:41.138073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6da5ee92-ac74-4f95-9fa6-7bbf0ed1b5ae tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149398 May 26 21:48:41.138650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1101/2192] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:41.202718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:41.203338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:41.209863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:41.210318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:41.211077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:41.211520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:41.348066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:41.356107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e8bd657e-7d9e-43be-a1ab-65b45c9f4e24 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.157233 May 26 21:48:41.356696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1092/2193] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:41 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:42.155355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:42.155925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:42.163180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:42.172412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:42.172412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:42.172412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:42.292133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:42.300622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2fb1b79f-594c-4e85-9649-04a9ed089989 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149213 May 26 21:48:42.301193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1102/2194] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:42.372956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:42.373668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:42.381467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:42.381929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:42.382739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:42.383278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:42.514356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:42.522563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a967445f-7aff-4a8b-ae3b-e2c74d60e008 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153461 May 26 21:48:42.523144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1093/2195] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:43.318196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:43.318792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:43.325324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:43.325771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:43.326524 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:43.326963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:43.460771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:43.469282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f80446f-90b2-4602-90e7-c08e0975e554 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.155277 May 26 21:48:43.469709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1103/2196] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:43 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:43.539183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:43.539812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:43.546420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:43.546877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:43.547647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:43.548090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:43.676756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:43.684730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7de3d0c0-4a43-4d99-8080-b73922ab3271 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149406 May 26 21:48:43.685358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1094/2197] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:44.485681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:44.486376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:44.493434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:44.493888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:44.494659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:44.495096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:44.627463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:44.636143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aab5c043-c52f-45dd-ba0c-c9b655fd3508 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154270 May 26 21:48:44.636721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1104/2198] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:44 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:44.702992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:44.703602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:44.710158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:44.710619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:44.711390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:44.711833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:44.845674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:44.853576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cce67c6a-f325-4ac8-845d-687a84a87b07 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.154534 May 26 21:48:44.854136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1095/2199] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:44 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:45.653238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:45.653884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:45.660941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:45.661402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:45.662166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:45.662606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:45.794035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:45.802444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2ee7bea1-24f7-44ed-8eea-8b19c2c0bb40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153116 May 26 21:48:45.803007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1105/2200] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:45.870277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:45.870903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:45.878968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:45.879421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:45.880187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:45.880642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:46.008473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:46.016679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d2e8a006-84a6-47ed-b548-22917de00c7e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.150256 May 26 21:48:46.017273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1096/2201] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:46.819845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:46.820390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:46.826346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:46.826793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:46.827541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:46.827979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:46.954820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:46.962700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9dd504b3-05a0-4ae2-addb-40619b5fb0b0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.148004 May 26 21:48:46.963256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1106/2202] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:46 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:47.034908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:47.035457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:47.042266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:47.042725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:47.043505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:47.043951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:47.176278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:47.184210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e274730e-d3f1-489d-9e83-7a26f1c57aac tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153740 May 26 21:48:47.184811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1097/2203] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:47.979384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:47.979988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:47.986628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:47.987724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:47.988483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:47.988940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:48.007219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:48.120254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:48.129276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-671049e5-abf9-4371-b8fa-fc88d5ed20f4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153685 May 26 21:48:48.129865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1107/2204] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:48.201099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:48.201718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:48.208740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:48.209194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:48.210000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:48.210386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:48.341132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:48.349909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fbd4978e-ba94-4c99-8fe4-2bdaa511fd6d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152669 May 26 21:48:48.350516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1098/2205] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:48 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:49.146380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:49.146995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:49.153175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:49.153621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:49.154439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:49.154807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:49.281973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:49.290451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a34cfc0a-ff65-4eca-b5f8-dbb4cccf5575 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.148164 May 26 21:48:49.291024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1108/2206] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:49 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:49.367509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:49.368128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:49.379081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:49.379538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:49.380300 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:49.380774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:49.509267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:49.517493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eaf3ee80-51c6-48c2-ab3a-12e1b958f69a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.153815 May 26 21:48:49.518089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1099/2207] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:50.307929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:50.308549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:50.315833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:50.316346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:50.317061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:50.317514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:50.450159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:50.461615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2f4e1050-1663-4b00-9714-e475c1758f4c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.157525 May 26 21:48:50.462236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1109/2208] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:50.535371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:50.535993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:50.542634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:50.543092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:50.543855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:50.544303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:50.674568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:50.682680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4a3524ff-67c6-4fe0-9f36-c240d43508ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.151832 May 26 21:48:50.683290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1100/2209] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:51.478826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:51.479476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:51.486078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:51.486356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:51.487115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:51.487546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:51.623676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:51.632058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eec900ab-5484-4966-a998-748523d4b057 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.157154 May 26 21:48:51.632647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1110/2210] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:51.699198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:51.699840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:51.707127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:51.707878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:51.709090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:51.709538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:51.840493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:51.849388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5762cd05-0935-45cc-a808-e3edf74f91ef tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.154008 May 26 21:48:51.849965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1101/2211] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:51 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:52.649850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:52.650463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:52.657084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:52.657536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:52.658389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:52.659383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:52.789271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:52.798157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c5955953-00ea-4a1e-abac-bc2cbdf7c839 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.152148 May 26 21:48:52.798734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1111/2212] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:52 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:52.866989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:52.867545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:52.874049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:52.874533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:52.875557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:52.876031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:53.005557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:53.013618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-be8a2d3e-6b37-43ce-89d4-8a09b826afd8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.150335 May 26 21:48:53.014189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1102/2213] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:53.816302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:53.816912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:53.823287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:53.823726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:53.824472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:53.824927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:53.953569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:53.961554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2adab77d-9838-4f3c-8b53-f264309398e9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149703 May 26 21:48:53.962128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1112/2214] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:53 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:54.031211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:54.031828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:54.038222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:54.038667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:54.039420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:54.039853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:54.169777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:54.178247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1690f5d3-76b8-48de-9192-dbbb2b1eb3b0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.150836 May 26 21:48:54.178822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1103/2215] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:54 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:54.979060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:54.979679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:54.982005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=52 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:54.986825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:54.987400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:54.988535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:54.988996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:55.118538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:55.126743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bee248d0-9d26-46f8-8288-23f7733f273c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.151541 May 26 21:48:55.127307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1113/2216] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:55.195498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:55.196520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:55.203156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:55.203618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:55.204418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:55.204891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:55.350984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:55.359497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aa0564db-1f1f-459d-a447-c943a41565a3 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.167968 May 26 21:48:55.360081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1104/2217] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:55 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:56.144283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:56.144902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:56.151585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:56.152058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:56.152843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:56.153280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:56.281268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:56.289444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b592a128-c6bd-4880-8cb5-ef62262db5cf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149085 May 26 21:48:56.290019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1114/2218] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:56 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:56.376211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:56.376794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:56.383886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:56.384339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:56.385131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:56.385579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:56.401185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:48:56.519932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:56.528072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b88b9fef-63e1-407f-866d-e0e2cbadcd4e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.156053 May 26 21:48:56.528661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1105/2219] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:56 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:57.306943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:57.307551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:57.314018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:57.314460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:57.315205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:57.315635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:57.447192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:57.455413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-10463f0e-5ba9-499c-be37-9725cd9cfe40 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.152249 May 26 21:48:57.455995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1115/2220] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:57.545731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:57.546386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:57.552498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:57.552984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:57.557534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:57.557534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:57.686283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:57.694401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2042a37a-8131-4b4a-80fc-c3e1a283e405 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152685 May 26 21:48:57.695000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1106/2221] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:58.474147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:58.474699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:58.481512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:58.481966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:58.482848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:58.483308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:58.625877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:58.638208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-401d5ec6-da49-42f4-9a14-1041535c522a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.168503 May 26 21:48:58.638790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1116/2222] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:58 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:48:58.711848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:58.712457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:58.719217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:58.719673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:58.720440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:58.720920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:58.852739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:58.860806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a0c0a0cf-0937-43d4-9ddc-3200c34949c1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152836 May 26 21:48:58.861379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1107/2223] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:58 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:59.655135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:59.655752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:59.662676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:59.662909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:59.663693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:59.664136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:59.794504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:48:59.802417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-07edb801-db73-4db4-8ba9-bbd7246e0752 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.151214 May 26 21:48:59.802993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1117/2224] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:59 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:48:59.879294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:48:59.879913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:48:59.886479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:59.886933 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:48:59.887696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:48:59.888134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:00.017776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:00.026200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b355db71-b552-4402-9a59-d99daead246d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.151606 May 26 21:49:00.026785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1108/2225] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:48:59 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:00.822336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:00.823312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:00.833263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:00.833998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:00.835265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:00.835900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:00.991310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:00.999878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d709aa55-4d54-46bd-8337-78d498bd0780 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.184045 May 26 21:49:01.000464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1118/2226] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:01.043519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:01.044122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:01.050798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:01.051259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:01.052025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:01.052468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:01.193574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:01.201526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8260086f-7618-4b53-8ce1-02dd270a4508 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.162108 May 26 21:49:01.202100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1109/2227] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:01 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:02.023274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:02.023274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:02.024604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:02.025067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:02.025834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:02.026273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:02.169876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:02.178559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c6e51e87-a1d1-47af-9f27-75d4d58339cb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.165854 May 26 21:49:02.179125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1119/2228] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:02.218456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:02.219122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:02.226117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:02.226573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:02.227348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:02.227790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:02.356275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:02.364243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-90571c10-271c-4f22-8d98-0ad299cf104b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149601 May 26 21:49:02.364845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1110/2229] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:03.195273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:03.195893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:03.202548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:03.203005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:03.203768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:03.204210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:03.331713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:03.339638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dfea3486-9a97-4557-9827-f80c30212f6d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.148276 May 26 21:49:03.340212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1120/2230] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:03 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:03.382283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:03.382832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:03.389279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:03.389733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:03.390492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:03.390936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:03.520509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:03.528555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da3c4af6-c1ae-48b4-b387-2152b66e0e6a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.150168 May 26 21:49:03.529142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1111/2231] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:03 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:04.357206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:04.357824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:04.364335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:04.364865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:04.365618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:04.366058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:04.499713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:04.507742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-73e5a992-381b-4dd0-93df-565af853e260 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154375 May 26 21:49:04.508342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1121/2232] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:04.545970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:04.546603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:04.548918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:04.554243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:04.554697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:04.555465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:04.555903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:04.685915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:04.694531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9763a685-d314-4aa5-8f83-544416133a66 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152437 May 26 21:49:04.695108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1112/2233] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:04 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:05.525194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:05.525819 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:05.532484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:05.532977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:05.533750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:05.534191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:05.667867 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:05.675886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1a7dc69d-1e81-4de1-8c00-dccea67c897a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154525 May 26 21:49:05.676462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1122/2234] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:05 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:05.711741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:05.712467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:05.719080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:05.719536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:05.720308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:05.720790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:05.847689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:05.855615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-63ccc568-3d22-49ac-b653-442ea98b2abd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.148401 May 26 21:49:05.856193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1113/2235] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:05 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:06.697355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:06.698013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:06.704498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:06.704978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:06.705739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:06.706178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:06.837499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:06.845478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ecabf1d-8a5a-4a3b-9f53-570c9dc5c4d9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.151967 May 26 21:49:06.846044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1123/2236] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:06 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:06.872415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:06.873065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:06.880440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:06.880952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:06.881716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:06.882156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:07.010192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:07.018232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-18226f8e-10d3-4cc9-a8da-e4dcee7caac9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149626 May 26 21:49:07.018802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1114/2237] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:06 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:07.862769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:07.863309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:07.869918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:07.870371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:07.871129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:07.871572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:07.875824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:07.999679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:08.008404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a11df190-b118-4e0f-a674-9d9bf02bee95 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149543 May 26 21:49:08.009038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1124/2238] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:08.035153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:08.035814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:08.042806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:08.043268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:08.044054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:08.044524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:08.192435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:08.201025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0e251f14-1f7f-426f-8bf7-138e8bc0b601 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.169586 May 26 21:49:08.201757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1115/2239] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:08 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:09.034413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:09.035032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:09.042146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:09.042588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:09.043337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:09.043766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:09.176113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:09.184227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5967b67f-85e5-435a-850c-c12830a5e4bf tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153699 May 26 21:49:09.184834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1125/2240] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:09 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:09.218210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:09.218836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:09.225906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:09.226363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:09.227166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:09.227614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:09.360362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:09.369019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8821f38b-cce3-4365-a40b-b7f79955110f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.154490 May 26 21:49:09.369608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1116/2241] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:09 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:10.201051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:10.201674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:10.208190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:10.208675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:10.209441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:10.209884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:10.337814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:10.345718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d63ae379-1509-49c9-8a14-91b8a27279fe tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.148469 May 26 21:49:10.346279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1126/2242] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:10.386350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:10.386906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:10.393338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:10.393792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:10.394553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:10.394990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:10.523666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:10.531598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea9b6e6d-f5cc-4f49-b463-8103c06475fc tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149255 May 26 21:49:10.532168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1117/2243] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:10 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:11.363146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:11.364269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:11.370821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:11.371295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:11.372058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:11.372492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:11.507509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:11.516638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a55605ab-ac8a-42b8-ad34-f2c7ae139616 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.157197 May 26 21:49:11.517553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1127/2244] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:11.549466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:11.550092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:11.557647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:11.558156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:11.558940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:11.559380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:11.689761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:11.698162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-17159645-50b7-46d2-9fb3-92c672c5918a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152196 May 26 21:49:11.698356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1118/2245] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:12.534357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:12.534959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:12.542143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:12.542587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:12.543340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:12.543773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:12.676175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:12.684660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f606f1cf-8570-4b21-a640-9b791824ca87 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.154095 May 26 21:49:12.685220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1128/2246] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:12 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:12.715019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:12.715641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:12.722156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:12.722612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:12.723883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:12.724323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:12.849702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:12.857606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-52cfc835-439a-4a8a-beb5-12aa3aa95559 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.146538 May 26 21:49:12.858187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1119/2247] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:12 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:13.701677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:13.702289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:13.709042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:13.709495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:13.710255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:13.710694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:13.846522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:13.855201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1f61dec1-e176-4ac4-8256-50da4c035060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.157369 May 26 21:49:13.855788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1129/2248] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:13.875528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:13.876180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:13.882691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:13.883141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:13.883902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:13.884341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:14.013107 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:14.021130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-68f829b2-ae67-4aab-a726-dfa7c088ec5a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149688 May 26 21:49:14.021680 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1120/2249] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:14.873073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:14.873700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:14.881082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:14.881536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:14.882296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:14.882735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:15.010557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:15.018911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-afaaef1f-ff88-4fe0-8d94-c23bd949cbc3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.149699 May 26 21:49:15.019482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1130/2250] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:15.038132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:15.038814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:15.045477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:15.045923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:15.046679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:15.047113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:15.178924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:15.186842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5bfebe00-2dd9-4953-9a87-54b8f6a49bce tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.152704 May 26 21:49:15.187404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1121/2251] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:16.035252 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:16.035861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:16.042443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:16.042889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:16.043643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:16.044075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:16.170675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:16.179286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7395fe59-4041-4466-a58b-a7765fdbce82 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.147906 May 26 21:49:16.179860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1131/2252] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:16 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:16.204323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:16.205010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:16.211514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:16.212004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:16.212805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:16.213246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:16.215780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:16.343440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:16.351838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f22f502-9c2c-43e1-88a6-601c0e9647dd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.151391 May 26 21:49:16.352412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1122/2253] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:17.197483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:17.198106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:17.204630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:17.205091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:17.205855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:17.206375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:17.331822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:17.340869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e69ccc75-a720-4d52-8d05-5553891b15b8 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.147198 May 26 21:49:17.341460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1132/2254] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:17 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:17.369547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:17.370899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:17.388128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:17.388128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:17.388128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:17.388128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:17.514145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:17.522245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71a59270-8b9f-4f1c-aabd-796cc534eedb tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.156576 May 26 21:49:17.522831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1123/2255] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:17 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:18.357882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:18.358468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:18.365001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:18.365450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:18.366199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:18.366632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:18.540776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:18.540776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:18.548286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:18.548862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:18.549741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:18.550249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:18.813661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:18.821797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3826bb48-1338-4d6e-8b74-0036ac8c4e5d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.467767 May 26 21:49:18.822388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1133/2256] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:18 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:18.837166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:18.845163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3048d40f-35c9-42bd-885e-2a761e7481c2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.309741 May 26 21:49:18.845739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1124/2257] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:19.839346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:19.839890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:19.846349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:19.846798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:19.847561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:19.848001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:19.862771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:19.863470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:19.870003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:19.870465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:19.871227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:19.871667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:20.037026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:20.045154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f16a59a0-be62-4467-a6ea-d0365ab42bbc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.209714 May 26 21:49:20.045739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1134/2258] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:20.053963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:20.062071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-46e523b3-f6e6-4c82-bc68-d6bcdab06a28 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.203233 May 26 21:49:20.062631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1125/2259] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:21.061731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:21.062320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:21.068921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:21.069375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:21.070134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:21.070569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:21.079573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:21.080312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:21.087419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:21.087875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:21.088672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:21.089112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:21.262684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:21.271337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-453f8ef4-2211-4c62-b9be-2eea582e4682 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.213623 May 26 21:49:21.271914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1135/2260] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:21.277311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:21.285511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-95805b9b-c05e-4239-b384-807fcdcfce1c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209831 May 26 21:49:21.286700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1126/2261] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:22.288082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:22.288730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:22.295300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:22.295754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:22.296518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:22.296996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:22.309859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:22.310492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:22.317736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:22.318195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:22.318966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:22.319412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:22.501644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:22.505423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:22.511359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-baf0d212-6f42-4308-a126-39ca4a60694e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227612 May 26 21:49:22.512259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1136/2262] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:22 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:22.513629 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4736e75f-7d6c-47ba-a0b8-e3e5f0651bae tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.207712 May 26 21:49:22.514208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1127/2263] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:22 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:23.529050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:23.529667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:23.530662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:23.531375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:23.537146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:23.537599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:23.538303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:23.538430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:23.538760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:23.538868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:23.539558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:23.540004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:23.736020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:23.739434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:23.744458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1fd517b2-2dc0-468e-a715-a5a919400e6e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219558 May 26 21:49:23.745348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1137/2264] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:23.747358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-859ae53f-a3e7-44e1-828f-630050ebaab2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220610 May 26 21:49:23.747938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1128/2265] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:23 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:24.763462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:24.764093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:24.764423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:24.765126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:24.770856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:24.771306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:24.771459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:24.771900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:24.772071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:24.772509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:24.772719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:24.773085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:24.976163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:24.978057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:24.984930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-837fcb71-fc85-4b59-ba8d-dd93c1c6b9c9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224148 May 26 21:49:24.985773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1129/2266] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:24.986383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-484837bf-6bcd-4553-bbf3-c0f5ccdb7cf1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226917 May 26 21:49:24.986958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1138/2267] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:26.007708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:26.008382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:26.010722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=52 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:26.014141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:26.014849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:26.016112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:26.016569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:26.017368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:26.017812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:26.022475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:26.022993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:26.023819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:26.024314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:26.223749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:26.230392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:26.232039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4c4caf2-da7a-4053-a8b2-eb3ff2472067 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.228807 May 26 21:49:26.232766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1139/2268] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:26.238425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-242aceac-d486-4002-9956-88f7f688b35e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.238507 May 26 21:49:26.239513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1130/2269] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:25 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:27.249792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:27.250610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:27.255536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:27.256160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:27.257076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:27.257533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:27.258306 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:27.258743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:27.262285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:27.262739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:27.263500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:27.263939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:27.503161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:27.507341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:27.508422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:27.512572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e844584d-15f3-4cbd-b4c1-b5cb8e1627e3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.266861 May 26 21:49:27.513195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1140/2270] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:27.517032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c2fc9b6-a0da-44c6-9192-fd8fd1e9f881 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.265245 May 26 21:49:27.517603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1131/2271] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:27 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:28.530813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:28.531487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:28.539289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:28.539855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:28.539855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:28.540071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:28.540643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:28.541088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:28.546438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:28.546897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:28.547672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:28.548117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:28.736787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:28.738133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:28.744892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7c1a3b0b-c734-4b1b-9410-72d0075f9bb9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217910 May 26 21:49:28.745483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1141/2272] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:28 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:28.746121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-517b4198-0d83-4f41-8084-be5608515ff8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.211219 May 26 21:49:28.746948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1132/2273] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:28 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:29.762198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:29.762794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:29.763174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:29.763397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:29.769435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:29.769890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:29.770278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:29.770706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:29.770822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:29.771145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:29.771505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:29.771950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:29.965314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:29.969466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:29.974001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a24e11ba-2fb4-4d26-a352-4104e88f27e1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215662 May 26 21:49:29.974581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1142/2274] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:29 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:29.977886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-27fdd40d-0c3c-429f-8a5d-a58bc1d3fa89 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218932 May 26 21:49:29.978452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1133/2275] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:29 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:30.991316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:30.992134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:30.995094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:30.995709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:31.000157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:31.000635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:31.001477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:31.002021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:31.002394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:31.002842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:31.003596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:31.004028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:31.201122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:31.208210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:31.210354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8a7d44c1-3b27-4227-a873-63d59ebeb974 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222982 May 26 21:49:31.210943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1143/2276] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:30 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:31.217052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f323007b-e981-4371-ae29-167ff2186809 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225939 May 26 21:49:31.220602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1134/2277] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:30 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:32.227998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:32.228560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:32.235124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:32.235573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:32.236368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:32.236838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:32.237000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:32.237622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:32.244317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:32.244808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:32.245586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:32.246031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:32.442948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:32.451124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:32.451315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-51d47dd8-3c50-46e2-9f30-71aeb21a92fb tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.227231 May 26 21:49:32.451731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1144/2278] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:32 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:32.460194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d5925d9f-fecb-4f17-8c44-0e95f6086fc6 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.227207 May 26 21:49:32.460884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1135/2279] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:32 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:33.468798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:33.469409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:33.475897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:33.476368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:33.477143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:33.477578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:33.477702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:33.478344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:33.484962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:33.485413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:33.486187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:33.486626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:33.679874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:33.683046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:33.688559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-33bb9488-9934-46e9-919d-1575e5541361 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223575 May 26 21:49:33.689180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1145/2280] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:33 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:33.690881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e42520a6-63cc-4f0a-8137-3864c5b45e88 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217596 May 26 21:49:33.691945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1136/2281] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:33 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:34.706522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:34.707621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:34.707827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:34.708343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:34.710665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:34.714738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:34.715194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:34.715332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:34.715786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:34.715977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:34.716423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:34.716542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:34.717002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:34.911082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:34.918117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:34.919743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e3a8f43-4505-4047-ac75-c49330ec3d50 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215591 May 26 21:49:34.919743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1137/2282] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:34 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:34.926719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-db7f7463-9c10-46da-aff3-bd0a7f91f30f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224341 May 26 21:49:34.927427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1146/2283] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:34 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:35.936520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:35.937160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:35.943017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:35.943662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:35.943849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:35.944303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:35.945116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:35.945549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:35.950136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:35.950565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:35.951320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:35.951755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:36.141740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:36.143920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:36.146210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:36.156229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f1331c3a-fbba-4f25-8b82-e7679e1f9fca tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218315 May 26 21:49:36.156229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1138/2284] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:35 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:36.161360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-26a0d7e1-52d5-4169-928d-17f8d69c04ed tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215550 May 26 21:49:36.161360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1147/2285] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:35 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:37.176310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:37.177620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:37.178019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:37.178299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:37.185085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:37.185269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:37.185542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:37.185987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:37.186313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:37.186443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:37.186797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:37.186917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:37.394785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:37.403403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5af7d8ce-7ca0-45fc-a3e8-2cbbd56193c3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.229886 May 26 21:49:37.403986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1148/2286] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:37 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:37.418336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:37.426306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e06a615c-fac7-4e63-a4fd-3490483b484f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.253842 May 26 21:49:37.427445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1139/2287] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:37 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:38.420659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:38.421311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:38.428442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:38.428917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:38.429679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:38.430122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:38.443781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:38.444431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:38.451584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:38.452037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:38.452835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:38.453284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:38.632802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:38.640510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:38.643684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-57b5563c-c927-4241-92b9-bebf5d12190f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.226875 May 26 21:49:38.644487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1149/2288] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:38 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:38.648759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7d86be82-e281-4b9c-b274-551356663bf7 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209394 May 26 21:49:38.649415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1140/2289] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:38 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:39.661250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:39.662368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:39.666869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:39.669473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:39.669623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:39.669623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:39.670243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:39.670680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:39.675191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:39.675652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:39.676418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:39.677058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:39.875196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:39.879215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:39.883298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9b15c971-f92e-43d0-85dc-9460d973013d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225939 May 26 21:49:39.883873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1150/2290] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:39 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:39.887279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-20dcefb7-2fff-44db-b338-9e296ac4b515 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225057 May 26 21:49:39.887837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1141/2291] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:39 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:40.899883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:40.900501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:40.904565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:40.905211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:40.907136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:40.907586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:40.908363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:40.908830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:40.911714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:40.912893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:40.913668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:40.914114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:41.105577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:41.109784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:41.113904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9da7bd9a-5df1-4205-8798-91b4886b003f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217954 May 26 21:49:41.114562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1151/2292] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:40 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:41.117960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6bb3df8c-94e9-4db0-b057-98280a881b42 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217137 May 26 21:49:41.118524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1142/2293] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:40 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:42.131795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:42.132346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:42.135093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:42.135719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:42.138931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:42.141964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:42.141964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:42.141964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:42.142391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:42.142854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:42.143628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:42.144070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:42.336404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:42.343430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:42.344704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8ea96588-a1de-486c-9e62-4afaf36df16c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217039 May 26 21:49:42.345462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1152/2294] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:42 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:42.351746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-87d1e626-e7f7-46da-901f-99e72749fdb5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220496 May 26 21:49:42.352366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1143/2295] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:42 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:43.361422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:43.362035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:43.369351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:43.369518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:43.369931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:43.370137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:43.370555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:43.370994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:43.377194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:43.377642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:43.378426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:43.378858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:43.561900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:43.570077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0e5d74e3-1c15-4712-b78e-379276289e8d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.212433 May 26 21:49:43.570647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1153/2296] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:43 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:43.571513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:43.581199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-14a0e7d4-0a6f-4d56-addd-aaadbda5a40a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.216051 May 26 21:49:43.581784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1144/2297] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:43 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:44.587461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:44.588506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:44.595512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:44.595962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:44.596757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:44.597191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:44.599428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:44.600215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:44.607337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:44.607943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:44.608735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:44.609174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:44.789966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:44.798422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-138cda27-e22c-405b-9b53-799df0fd574a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214811 May 26 21:49:44.798859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1154/2298] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:44 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:44.800864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:44.809502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c077e2e5-0122-422d-a5b0-ae86a68c390a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.214966 May 26 21:49:44.810072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1145/2299] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:44 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:45.816032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:45.816722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:45.823779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:45.824227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:45.825017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:45.825455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:45.826709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:45.827356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:45.833878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:45.834326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:45.835093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:45.835529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:46.019731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:46.026403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:46.029937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7eedca18-0fc1-4d45-b12c-0a751d89e91c tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217900 May 26 21:49:46.030723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1155/2300] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:45 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:46.034699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c13b6451-5d2e-4612-a563-520f4fd7410e tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.211721 May 26 21:49:46.035261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1146/2301] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:45 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:47.050191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:47.050818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:47.051219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:47.051853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:47.057227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:47.057683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:47.058327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:47.058463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:47.058788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:47.058923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:47.059580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:47.060025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:47.260891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:47.264844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:47.269153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0aee593f-ced6-4117-83d6-222ba58f6ab4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223301 May 26 21:49:47.269734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1156/2302] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:47 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:47.272840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-42f1658b-8247-4ce9-8bd4-62efd9199423 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225561 May 26 21:49:47.273330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1147/2303] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:47 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:48.286579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:48.287412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:48.290412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:48.291117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:48.293762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:48.294217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:48.294982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:48.295453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:48.297564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:48.298019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:48.298783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:48.299224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:48.314207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:48.493464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:48.496998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:48.501792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e494d6a-e6fa-4e50-bd99-2549c120eddc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219110 May 26 21:49:48.502381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1157/2304] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:48 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:48.505257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea1b31b8-9a3e-4090-84e9-2e60d9972cf8 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.219462 May 26 21:49:48.505829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1148/2305] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:48 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:49.519716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:49.520471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:49.522917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:49.524125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:49.526987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:49.527444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:49.528214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:49.528682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:49.530847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:49.531294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:49.532242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:49.532768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:49.730186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:49.733461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:49.740821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9ef50930-9537-4515-8083-e9af7f54f5e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225137 May 26 21:49:49.741532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1158/2306] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:49 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:49.741675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e76d4946-6759-49bc-a090-20e7c18ada9d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222719 May 26 21:49:49.742218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1149/2307] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:49 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:50.758730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:50.759313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:50.759719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:50.759845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:50.766665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:50.766911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:50.767117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:50.767371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:50.767887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:50.768141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:50.768323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:50.768613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:50.967487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:50.975687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-01a3e9b5-94d1-4c84-a4ce-7e2c9f0c3d5f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220801 May 26 21:49:50.976273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1159/2308] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:50 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:50.977756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:50.992564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc698f3a-59e4-4f90-8472-0318b5bfc286 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.237025 May 26 21:49:50.993204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1150/2309] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:50 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:51.993245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:51.993917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:52.000508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:52.000990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:52.001751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:52.002184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:52.010271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:52.011386 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:52.017853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:52.018308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:52.019059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:52.019491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:52.188223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:52.196238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7acfb64a-995d-46c1-96d8-dae6c972c14a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.206962 May 26 21:49:52.196912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1160/2310] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:51 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:52.210016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:52.218663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-98d2d3f2-47b0-4480-8c15-5aec8b06c176 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.212231 May 26 21:49:52.219225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1151/2311] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:52 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:52.477873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:49:52.478116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:49:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:49:53.214431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:53.215122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:53.221609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:53.222061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:53.222822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:53.223264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:53.238234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:53.238997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:53.245668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:53.246122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:53.246888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:53.247328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:53.422205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:53.433343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0081817-1f77-4283-a039-e80cb26052aa tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221252 May 26 21:49:53.433343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1161/2312] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:53 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:53.435555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:53.444159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1c8edf7-c701-480f-9ccf-2b55beaa799a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209651 May 26 21:49:53.445125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1152/2313] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:53 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:54.449620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:54.450244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:54.456762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:54.457629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:54.458520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:54.458960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:54.462590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:54.463245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:54.469798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:54.470468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:54.471251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:54.471740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:54.674770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:54.678205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:54.682996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d1c1924d-80b9-48df-86a1-9a92bdcfb83f tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.238369 May 26 21:49:54.683570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1162/2314] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:54 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:54.686811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71d26619-6067-4dfe-b0df-ca14d86444d5 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.228372 May 26 21:49:54.687489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1153/2315] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:54 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:55.701080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:55.701702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:55.703707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:55.704277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:55.708697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:55.709155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:55.709927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:55.710371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:55.710663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:55.711119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:55.711885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:55.712329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:56.154620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:56.162312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:56.162515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aef68fb3-9243-4904-a066-5421c58b5125 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.465353 May 26 21:49:56.163520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1163/2316] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:55 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:56.170900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a87824cb-e490-4685-8384-a17771113d0a tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.470952 May 26 21:49:56.171661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1154/2317] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:55 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:57.180329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:57.181055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:57.183924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=50 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:57.188344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:57.188884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:57.189002 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:57.189281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:57.190054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:57.190496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:57.195416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:57.195866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:57.196649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:57.197144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:57.213298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:49:57.382672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:57.386628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:57.390757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-add0e855-f9d7-4631-8c90-1da43f3c0b10 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214293 May 26 21:49:57.391332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1164/2318] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:57 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:57.394539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-896c5138-6313-47a6-b718-a3ac5e9098df tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.209952 May 26 21:49:57.395104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1155/2319] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:57 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:58.408234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:58.408853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:58.410942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:58.411573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:58.415654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:58.416111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:58.416902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:58.417342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:58.418105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:58.418562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:58.419329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:58.419771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:58.617741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:58.622073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:58.627248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7577fcf5-f12f-4b75-b819-0a1a44fbd9be tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.223094 May 26 21:49:58.628026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1165/2320] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:58 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:58.631116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0bfaedf5-ae52-4a04-aa33-05774dc6a53d tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.223910 May 26 21:49:58.631824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1156/2321] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:58 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:49:59.645230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:59.645796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:59.647013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:49:59.647638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:49:59.652460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:59.652959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:59.653730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:59.654170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:59.654315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:59.654684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:59.655592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:49:59.656035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:49:59.852732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:59.860290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:49:59.861256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bab04ef4-d4be-4617-a3a2-b528b0cfdd52 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.220313 May 26 21:49:59.861823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1166/2322] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:59 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:49:59.868757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-73472676-b4cc-45cc-85b2-aa2b6b69f7f0 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225547 May 26 21:49:59.869425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1157/2323] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:49:59 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:00.878817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:00.879534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:00.886254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:00.886708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:00.887090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:00.887542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:00.887857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:00.887994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:00.894518 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:00.894978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:00.895755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:00.896195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:01.082473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:01.085924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:01.090964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5554d781-a1ea-43e2-98c1-db7bcf62db7e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215906 May 26 21:50:01.091554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1167/2324] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:00 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:01.094021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-29019e01-f960-4afa-bfc7-b0b5d138d58f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.210792 May 26 21:50:01.094582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1158/2325] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:00 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:02.107830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:02.108528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:02.110720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:02.111350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:02.115319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:02.123947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:02.123947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:02.123947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:02.124355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:02.124355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:02.124355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:02.124355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:02.313466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:02.316378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:02.321722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4e7c9ffe-4abe-49c3-8a3b-51234d0733e2 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217870 May 26 21:50:02.322302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1168/2326] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:02 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:02.324277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aa75c880-c3c9-4942-b900-a3ade6b22ed2 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217431 May 26 21:50:02.324872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1159/2327] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:02 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:03.339494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:03.340091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:03.342302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:03.342928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:03.347632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:03.348222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:03.348558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:03.349016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:03.350368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:03.350831 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:03.351603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:03.352162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:03.543147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:03.549765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:03.560311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-79d6a702-cb09-434f-9943-74bf055f3004 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221890 May 26 21:50:03.561323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1160/2328] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:03 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:03.572432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-801452a5-f7e7-44c3-8999-8083587a8fe5 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.225676 May 26 21:50:03.573291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1169/2329] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:03 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:04.578039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:04.578666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:04.585473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:04.585976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:04.586765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:04.587209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:04.590100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:04.590720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:04.597460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:04.597912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:04.598721 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:04.599160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:04.791135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:04.795051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:04.799922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0cf2bbf7-e748-40b3-9e26-00f0054a2bad tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.226359 May 26 21:50:04.800906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1161/2330] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:04 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:04.803592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bd84ebf9-d1a7-4d7f-8f7e-3d67b515a695 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217199 May 26 21:50:04.804156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1170/2331] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:04 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:05.818649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:05.819238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:05.820960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:05.821597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:05.821747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=50 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:05.827146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:05.827599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:05.828369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:05.828772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:05.839344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:05.839529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:05.839529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:05.839529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:06.024710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:06.027981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:06.033153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0ca2ae4-c9bd-449e-a3da-a8bd5d124500 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.215774 May 26 21:50:06.034093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1171/2332] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:05 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:06.037326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-220e4899-662d-4c9a-9f6c-6da5b416ef60 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222632 May 26 21:50:06.046628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1162/2333] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:05 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:07.050589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:07.051395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:07.054660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:07.055074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:07.057791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:07.058243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:07.059005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:07.059571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:07.061558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:07.062021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:07.062791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:07.063234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:07.272302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:07.275679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:07.280607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bcb1fa47-e510-436e-a13e-d370ddd73a5a tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.233888 May 26 21:50:07.281207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1172/2334] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:07 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:07.283971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b8bd63b0-b873-45bd-b1dc-18038e615b9f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.233704 May 26 21:50:07.284542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1163/2335] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:07 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:08.297773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:08.298347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:08.300519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:08.301189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:08.305070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:08.305527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:08.306299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:08.306739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:08.307645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:08.308099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:08.308901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:08.309343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:08.504919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:08.508771 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:08.513055 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d39901a-e16c-43d5-b1ea-06aa4933fee9 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219173 May 26 21:50:08.513637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1173/2336] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:08 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:08.517147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-274cdbab-e122-437f-b4ae-b2a47f84370f tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220402 May 26 21:50:08.517808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1164/2337] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:08 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:09.529526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:09.530155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:09.534574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:09.535229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:09.537489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:09.538041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:09.538812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:09.539244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:09.541681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:09.542143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:09.542942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:09.543388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:09.543513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:09.739063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:09.744612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:09.747163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-176a68ba-41b4-49e0-a910-00e9e09a43e0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221679 May 26 21:50:09.747998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1174/2338] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:09 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:09.750939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-43f5530a-b15e-436e-9404-9d9fde4cf7b4 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220747 May 26 21:50:09.751510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1165/2339] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:09 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:10.764835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:10.765422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:10.767093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:10.767713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:10.771881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:10.772330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:10.773164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:10.773601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:10.774255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:10.774724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:10.775489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:10.775936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:10.968169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:10.972805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:10.977325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-00c347b0-5647-4094-a397-4d99765c1166 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216685 May 26 21:50:10.977975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1175/2340] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:10 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:10.981053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-17885ba3-d3b9-4dc0-8342-0da3360db60c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217819 May 26 21:50:10.981618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1166/2341] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:10 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:11.995235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:11.995954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:11.998498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:11.999130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:12.003446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:12.003910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:12.004706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:12.005152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:12.006346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:12.006810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:12.007580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:12.008437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:12.197200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:12.204452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:12.205931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-111d4ce1-e3d3-48e5-8624-fb9a8d103ca4 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.214632 May 26 21:50:12.206556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1176/2342] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:11 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:12.212718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba441c25-cb33-433d-bd05-4e639ffd0b90 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.218179 May 26 21:50:12.218178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1167/2343] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:11 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:13.222825 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:13.223976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:13.230658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:13.231102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:13.231851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:13.232283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:13.233150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:13.233814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:13.240881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:13.241372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:13.242147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:13.242591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:13.432601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:13.433742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:13.441070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c05f0973-c29f-4680-b92a-c1bd641ff66e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221973 May 26 21:50:13.441661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1177/2344] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:13 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:13.441928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e33c787e-8b66-4a36-9731-f28f28cb9e18 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.212528 May 26 21:50:13.442566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1168/2345] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:13 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:14.458668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:14.459207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:14.459600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:14.459715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:14.466083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:14.466234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:14.466546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:14.466680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:14.467317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:14.467435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:14.467858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:14.467973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:14.666860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:14.671582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:14.675551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a61a6f02-32c2-42ae-9d69-a09198d2c7dc tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221174 May 26 21:50:14.676134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1178/2346] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:14 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:14.680772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da4bb1c2-3199-4f02-b80b-bf5ff1f16ef1 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.225475 May 26 21:50:14.681347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1169/2347] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:14 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:15.693480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:15.694468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:15.697721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:15.698337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:15.701958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:15.702413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:15.703200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:15.703637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:15.704409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:15.704896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:15.705674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:15.706117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:15.900923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:15.905400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:15.909173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-48929768-5cba-435f-ac27-d330fb0c8d2b tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.219432 May 26 21:50:15.909762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1179/2348] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:15 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:15.913508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f81b744e-7851-4bd0-abd8-695c6a9f582c tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.220176 May 26 21:50:15.914072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1170/2349] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:15 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:16.931161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:16.931812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:16.932217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:16.932320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:16.938118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:16.938575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:16.938703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:16.939108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:16.939338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:16.939873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:16.940179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:16.940319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:17.139622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:17.142791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:17.147977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3c7b4d28-cdc6-45e8-9d23-3e697d160bb0 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221437 May 26 21:50:17.148794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1180/2350] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:16 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:17.150644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0babc3a0-4182-4b78-8845-b55670febb34 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.224124 May 26 21:50:17.151215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1171/2351] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:16 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:18.164381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:18.165026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:18.167160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:18.167784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:18.171727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:18.172183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:18.172986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:18.173426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:18.174155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:18.174603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:18.175365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:18.175803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:18.180264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:18.370138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:18.377523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:18.378411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-987a408d-a404-4f70-88e9-3fd16913b26d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.217825 May 26 21:50:18.378990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1181/2352] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:18 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:18.386073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c25cfd30-dc89-482e-997f-a4cb15a48035 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222668 May 26 21:50:18.386641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1172/2353] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:18 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:19.395116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:19.395731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:19.402799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:19.403072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:19.403535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:19.403693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:19.403995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:19.404432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:19.410503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:19.410956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:19.411779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:19.412158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:19.607088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:19.611648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:19.615381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7c98c8b7-f669-44a4-b0da-2b506501441d tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.224061 May 26 21:50:19.615966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1182/2354] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:19 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:19.622168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e0363de-2a21-4807-b161-6c3bb4917e00 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.222639 May 26 21:50:19.622756 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1173/2355] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:19 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:20.634115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:20.634757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:20.639033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:20.639657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:20.641676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:20.642124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:20.642892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:20.643327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:20.646297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:20.646807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:20.648193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:20.648670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:20.839791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:20.845087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:20.848242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7ad3259d-bfd1-44dc-92c9-565c9da017df tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218707 May 26 21:50:20.857013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-82b7f016-700f-442b-bd5c-6ed5d3c5fa8b tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221707 May 26 21:50:20.857701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1183/2356] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:20 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:20.858132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1174/2357] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:20 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:21.866786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:21.867451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:21.874814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:21.875303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:21.875594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:21.876205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:21.876329 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:21.876677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:21.883599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:21.884061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:21.884859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:21.885526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:22.074580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:22.078648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:22.082655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e66e2810-92d0-4f04-b35b-f6cb1b807890 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.221478 May 26 21:50:22.083241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1184/2358] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:21 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:22.086602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-96add83e-f923-45b9-8659-756d5e2ac8af tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.215369 May 26 21:50:22.087157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1175/2359] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:21 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:23.099267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:23.099902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:23.103560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:23.104175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:23.106485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:23.106951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:23.107741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:23.108168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:23.110070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:23.110524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:23.111276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:23.111707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:23.303293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:23.307994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:23.311750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-57a7d66e-46c6-48be-850c-9cc39f3591c1 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.216369 May 26 21:50:23.312329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1185/2360] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:23 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:23.316292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cea43635-1507-46ab-9903-8449a4b312e9 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217103 May 26 21:50:23.316971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1176/2361] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:23 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:24.329463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:24.330080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:24.333952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:24.334588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:24.337249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:24.337702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:24.338520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:24.338958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:24.341978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:24.342426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:24.343185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:24.343617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:24.535672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:24.538686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:24.543971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e0efec81-8d01-455c-b906-8d07701c8060 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.218352 May 26 21:50:24.544559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1186/2362] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:24 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:24.547444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-18e3d99f-1e57-4c89-bdaa-8f64fc1ccf05 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.217315 May 26 21:50:24.548012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1177/2363] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:24 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:25.561794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:25.562413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:25.564760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:25.565388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:25.569222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:25.569675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:25.570441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:25.570879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:25.571926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:25.572381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:25.573376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:25.573816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:25.771079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:25.774750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:25.780162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e314e99f-20ca-4077-b337-c7373a19efb3 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.222836 May 26 21:50:25.782585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1187/2364] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:25 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:25.782824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-596dd6d2-491a-4ffa-91cb-697ae8f91269 tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.221832 May 26 21:50:25.783401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1178/2365] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:25 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:26.083215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:26.083704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:26.091777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.092221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.093007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.093438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.121240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:50:26.495994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1841262d-4c60-4862-ad39-efcb87064bc7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 204 len: 0 microversion: 2.1 time: 0.416298 May 26 21:50:26.502687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1188/2366] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:50:26 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:50:26.505135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:26.505770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:26.511916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.512371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.513208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.513649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.642123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:26.650121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5c595429-bebb-473f-a990-5e079ec7c7da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1719 microversion: 2.1 time: 0.148940 May 26 21:50:26.650691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1179/2367] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1719 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:26.776221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:26.776856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:26.783345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.783806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.784563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.785030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.789578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:26.797122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:26.800064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:26.803750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.804830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.805600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.806038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.811811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:50:26.938699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:26.946691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9bda0ad6-5acd-4bb2-b2dd-f1cfc286f245 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.153448 May 26 21:50:26.947278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1180/2368] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:26 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:26.951745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:26.952349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] [instance: 0e6ec354-4f9e-406a-80a5-90856a7fead8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:26.958414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.958861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:26.959615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:26.960044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.089786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f45b8987f3c24cf19de0fa81482c050a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31ea80663206487ca3ea28c5bb4239f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:27.097812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-298e9c6a-ccde-4a57-8af7-e6cb18d5dcfd tempest-VolumesSnapshotTestJSON-1512769123 tempest-VolumesSnapshotTestJSON-1512769123-project] 10.222.0.66 "GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8" status: 200 len: 1558 microversion: 2.1 time: 0.149589 May 26 21:50:27.098389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1181/2369] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:26 2022] GET /compute/v2.1/servers/0e6ec354-4f9e-406a-80a5-90856a7fead8 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:27.165031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-613f1a0f-c0d1-4c3e-8cca-ac413959a71a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 204 len: 0 microversion: 2.1 time: 0.392649 May 26 21:50:27.165603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1189/2370] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:50:26 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 21:50:27.179668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:27.179668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:27.184441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.184936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.185822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.186158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.332547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:27.340998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dbfbe29f-7de8-4bbb-a3d1-245e683fd5f5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.170933 May 26 21:50:27.341576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1182/2371] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:27.668444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:27.669270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:27.671248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:27.676255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.676746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.677521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.677960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.819421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:27.828735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-73d15a47-9fee-4233-8c22-bc3ff94c9612 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1719 microversion: 2.1 time: 0.164554 May 26 21:50:27.829308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1190/2372] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:27.964093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:27.967886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] [instance: c371c14f-9d30-4fb1-8986-4ca9550e4fc8] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:27.971066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.971540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:27.972319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:27.972858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:28.218277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3e7bb3f129f47c7869f3319f35ed15e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '198b0d7e8b204f858abb8474f90af623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:28.228555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6f7c233e-7cd8-4c14-a76a-105d43e9a91e tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8" status: 200 len: 1599 microversion: 2.1 time: 0.268329 May 26 21:50:28.229368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1183/2373] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:27 2022] GET /compute/v2.1/servers/c371c14f-9d30-4fb1-8986-4ca9550e4fc8 => generated 1599 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:28.247001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4f1cd94f-c500-4d3f-b0e6-2e2d7c924b34 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] Calling method '.version_select at 0x7f46c8254280>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:28.359111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:28.359732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:28.366100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:28.366555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:28.367326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:28.367763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:28.371498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4f1cd94f-c500-4d3f-b0e6-2e2d7c924b34 tempest-TestMinimumBasicScenario-316803243 tempest-TestMinimumBasicScenario-316803243-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1406618544" status: 202 len: 0 microversion: 2.1 time: 0.129524 May 26 21:50:28.372358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1191/2374] 10.222.0.66 () {58 vars in 1271 bytes} [Thu May 26 21:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1406618544 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:50:28.775110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:28.783884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d53589d4-b2bd-49e5-9573-b19b742f1d91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.428575 May 26 21:50:28.784465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1184/2375] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:28.846136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:28.846679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:28.853460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:28.853917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:28.854697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:28.855305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:28.971144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:28.971144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4e412e11-82a5-4da9-a684-8d42bf6f2d2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1652 microversion: 2.1 time: 0.097568 May 26 21:50:28.971144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1192/2376] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1652 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:29.219183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3748fe34-6403-4819-a21a-19fd842440b9", "name": "network-vif-deleted", "tag": "8bf7c6f2-a31b-4347-a5f9-b986a9a803c3"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:50:29.234850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.235303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:29.257183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] Creating event network-vif-deleted:8bf7c6f2-a31b-4347-a5f9-b986a9a803c3 for instance 3748fe34-6403-4819-a21a-19fd842440b9 on hv-cinder-82880 May 26 21:50:29.266802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:50:29.337287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:29.342628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:29.344777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.345237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:29.346017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.346459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:29.396809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:50:29.814834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-56fbffde-8e6b-49d3-a68e-6aac4e39bb06 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 204 len: 0 microversion: 2.1 time: 0.482936 May 26 21:50:29.815602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1193/2377] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:50:29 2022] DELETE /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:50:29.822831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:29.823537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:29.829730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.830179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:29.830938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.831373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:29.973469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:29.982382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-134b176a-2178-48ff-bbcd-2a1e00a3e1f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.165046 May 26 21:50:29.982970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1194/2378] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:29.987639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:29.988457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:29.994912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:29.995440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:30.000161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:30.000161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:30.139814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:30.149174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e07aa82c-28e7-4524-8c79-b6fbebce9fe9 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1509 microversion: 2.1 time: 0.164615 May 26 21:50:30.149838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1195/2379] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:29 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:30.161163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:30.161854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:30.168991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:30.169735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:30.170751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:30.171259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:30.246965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:30.256784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b775d3cd-eedd-4218-a5e9-9c2cff8482b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.105625 May 26 21:50:30.257373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1196/2380] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:30.277063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] [c3988aa3-5e9f-4b0d-b50e-5ad9f7e014cc] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 50390. May 26 21:50:30.281861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-58d2b5c3-9d9a-4ad8-a77a-918a90cc59bf req-bee084ca-ec2d-4aed-b2e9-715228b0564d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.066964 May 26 21:50:30.283575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1185/2381] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:50:31.000483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:31.001099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:31.008677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.015677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.015677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.015677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.175136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:31.176137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:31.185474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:31.190925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.191609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.192397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.192876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.193603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aefb7a34-70a8-42ce-8093-8244ec0d08cf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.197432 May 26 21:50:31.194186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1197/2382] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:31.278215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:31.279234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:31.288676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.289987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.290787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:31.291293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:31.309537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:31.321175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9486ff34-0fd8-477f-a8c5-7c98b0c153c4 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 200 len: 1467 microversion: 2.1 time: 0.148717 May 26 21:50:31.322020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1186/2383] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:31 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:31.389644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:31.399092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b24bbd21-291b-46b4-b98a-b08144995aea tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.124386 May 26 21:50:31.399973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1198/2384] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:32.211583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:32.212490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:32.219483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.222335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.222335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.222335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.303737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-8298862c-21aa-4cf2-bb48-f3369a599b61 req-78c7c0d0-1359-4825-9772-9045d4333b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12d905a5-35e5-4d85-9ae5-a2c6406a9256", "name": "network-vif-deleted", "tag": "e328d4de-1566-4fa3-b89e-887685d736a1"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:50:32.335641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-8298862c-21aa-4cf2-bb48-f3369a599b61 req-78c7c0d0-1359-4825-9772-9045d4333b96 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.337270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-8298862c-21aa-4cf2-bb48-f3369a599b61 req-78c7c0d0-1359-4825-9772-9045d4333b96 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.353693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-8298862c-21aa-4cf2-bb48-f3369a599b61 req-78c7c0d0-1359-4825-9772-9045d4333b96 service nova] Creating event network-vif-deleted:e328d4de-1566-4fa3-b89e-887685d736a1 for instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 on hv-cinder-82880 May 26 21:50:32.360467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-8298862c-21aa-4cf2-bb48-f3369a599b61 req-78c7c0d0-1359-4825-9772-9045d4333b96 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062359 May 26 21:50:32.362045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1199/2385] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:50:32.372260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:32.372260 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: 12d905a5-35e5-4d85-9ae5-a2c6406a9256] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:32.377424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.378354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.379500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.380135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.395673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:32.397108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] HTTP exception thrown: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Request method failure captured: May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 HTTP/1.1 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9Lywr7t29tQKjqxr7PwohxXejXbDaHBuXWMMi5P_489EhxMYG6tgDPLDaXH3vgSQAhjDcaor4wPUGJxF4vwV2X7tvN8sBzt9VzUPjyF3h23H2PG4Akxi1arIc5wSELD9NsUsSJpW4EVaCl8cZq85cAT-7wiY_413giSCo3sFb4XI0 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:50:32.399040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 23ed95370bfd46e3a1c6946701e66065 May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. May 26 21:50:32.401003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '12d905a5-35e5-4d85-9ae5-a2c6406a9256'} May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:50:32.402057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. May 26 21:50:32.403808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:32.405692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Returning 404 to user: Instance 12d905a5-35e5-4d85-9ae5-a2c6406a9256 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:50:32.405692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c35ef00e-01a5-4b56-a388-440712b598a1 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256" status: 404 len: 111 microversion: 2.1 time: 0.037351 May 26 21:50:32.405692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1200/2386] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:32 2022] GET /compute/v2.1/servers/12d905a5-35e5-4d85-9ae5-a2c6406a9256 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:50:32.413544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3c9a172e-9511-4a43-9342-e3805737c5c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.206856 May 26 21:50:32.414776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1187/2387] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:32.420743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:32.421619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:32.425657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:32.426300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:32.428872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.430055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.431022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.431637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.433631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.435165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.436519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.437087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.469492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:50:32.516067 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:32.524813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7ad3b4f3-4056-4a9d-8d8d-9917d3beca20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.108674 May 26 21:50:32.525403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1188/2388] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:32.757461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f14f0ed0-cd9d-4d08-a860-9d16df75d1f2 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 204 len: 0 microversion: 2.1 time: 0.347622 May 26 21:50:32.758470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1201/2389] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:50:32 2022] DELETE /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:50:32.766684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:32.767736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:32.773912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.774419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.775930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:32.776601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:32.792949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:32.919015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:32.927534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-214e80b6-453c-4f50-8a55-231135d2a733 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.164791 May 26 21:50:32.930811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1189/2390] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:32 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:33.432308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:33.434268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:33.441715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.442513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:33.447370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.447840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:33.541897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:33.542420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:33.551849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.552304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:33.562161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.562773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:33.680478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:33.692084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-43b0eb35-aedf-4f49-9fca-786ca3a97512 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.153052 May 26 21:50:33.694016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1190/2391] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:33.716237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:33.726590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d28bf4df-93df-453c-b7bc-3f0346af5154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.298861 May 26 21:50:33.727173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1202/2392] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:33.945475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:33.946091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:33.952795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.953326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:33.954251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:33.954739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.154638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:34.162646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2685d7bf-2c9a-4390-9197-eab1ed03c023 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1521 microversion: 2.1 time: 0.221037 May 26 21:50:34.163135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1191/2393] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:33 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:34.379717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-66372936-3123-4999-b869-da1e611065ac req-b3851824-074d-4e43-b16a-d74813460174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3", "name": "network-vif-deleted", "tag": "d5a7772c-a49f-4686-b4ba-78b4ac8f17bf"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:50:34.387831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-66372936-3123-4999-b869-da1e611065ac req-b3851824-074d-4e43-b16a-d74813460174 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:34.388345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-66372936-3123-4999-b869-da1e611065ac req-b3851824-074d-4e43-b16a-d74813460174 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.392047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:34.399129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-66372936-3123-4999-b869-da1e611065ac req-b3851824-074d-4e43-b16a-d74813460174 service nova] Creating event network-vif-deleted:d5a7772c-a49f-4686-b4ba-78b4ac8f17bf for instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 on hv-cinder-82880 May 26 21:50:34.404182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-66372936-3123-4999-b869-da1e611065ac req-b3851824-074d-4e43-b16a-d74813460174 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028090 May 26 21:50:34.404811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1203/2394] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:50:34.710166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:34.710903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:34.718292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:34.719075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.720331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:34.720691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.747140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:34.748866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:34.757824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:34.758587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.760340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:34.760881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:34.802221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:34.810163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a0766d78-eace-46cd-983b-3b3f6e529609 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.103767 May 26 21:50:34.815324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1192/2395] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:34.901309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:34.909371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1ce30cd8-e698-484e-8119-fdfd86415cdb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.167757 May 26 21:50:34.909944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1204/2396] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:35.180211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:35.180856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:35.186964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.187416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.188181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.188652 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.220834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.221281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.221741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lazy-loading 'fault' on Instance uuid a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:50:35.263885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23ed95370bfd46e3a1c6946701e66065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77e3090ea4348b5686ebf62749f38', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:35.271626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1f6917fd-2f61-4d20-b387-3d20f364b472 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 200 len: 1311 microversion: 2.1 time: 0.095473 May 26 21:50:35.272195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1193/2397] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:35 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:35.827701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:35.828280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:35.835330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.835781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.836539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.837007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.898317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:35.907060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-13f351cc-7d07-431f-876b-8a804e9aefaa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083297 May 26 21:50:35.907624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1205/2398] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:35.927018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:35.927637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:35.930035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=66 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:35.934798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.935253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:35.936019 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:35.936462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:36.069305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:36.076358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3f60805c-cd71-4555-be07-9ef755e3e353 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153141 May 26 21:50:36.076965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1194/2399] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:36.289543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:36.290165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] [instance: a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:36.296268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:36.296758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:36.297522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:36.297961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:36.311593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] HTTP exception thrown: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Request method failure captured: May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 HTTP/1.1 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9Lywr7t29tQKjqxr7PwohxXejXbDaHBuXWMMi5P_489EhxMYG6tgDPLDaXH3vgSQAhjDcaor4wPUGJxF4vwV2X7tvN8sBzt9VzUPjyF3h23H2PG4Akxi1arIc5wSELD9NsUsSJpW4EVaCl8cZq85cAT-7wiY_413giSCo3sFb4XI0 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:50:36.313262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/9be77e3090ea4348b5686ebf62749f38"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 9be77e3090ea4348b5686ebf62749f38 May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1698501232 May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 23ed95370bfd46e3a1c6946701e66065 May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1698501232-project May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. May 26 21:50:36.315035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3'} May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:50:36.316024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. May 26 21:50:36.317676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:50:36.319147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] Returning 404 to user: Instance a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:50:36.319147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6c58fc8e-d20b-461c-9bbe-bb815d2f4090 tempest-ServerRescueNegativeTestJSON-1698501232 tempest-ServerRescueNegativeTestJSON-1698501232-project] 10.222.0.66 "GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3" status: 404 len: 111 microversion: 2.1 time: 0.029023 May 26 21:50:36.319147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1206/2400] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:36 2022] GET /compute/v2.1/servers/a9bbf58f-24f4-401e-8d5d-e11dc7aa9cc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:50:36.923753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:36.924372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:36.930461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:36.931089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:36.931695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:36.932139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:36.994661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:37.003185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db63885a-1f78-4d1c-800a-0b2c50545bc6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083206 May 26 21:50:37.004080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1195/2401] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:37.094097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:37.094692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:37.102052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:37.102545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:37.103318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:37.104457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:37.241902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:37.250413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-20114a6e-2982-4403-8590-f6ff6b139a8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.160376 May 26 21:50:37.250985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1207/2402] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:38.019391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:38.020000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:38.027157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:38.027613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:38.028392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:38.028890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:38.120003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:38.129343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fac19ed9-3037-40c5-8b1c-5d605c806d8d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.113776 May 26 21:50:38.129926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1196/2403] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:38.268319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:38.269041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:38.275979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:38.276254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:38.277292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:38.277905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:38.490849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:38.500298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ae5f646e-5f39-41a1-9d59-9c1b53ce09bf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.235759 May 26 21:50:38.501215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1208/2404] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:39.146499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:39.147111 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:39.157706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:39.158208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:39.158966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:39.160102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:39.240082 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:39.249496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c7d8410c-0c85-4e63-81f5-f8b06f4708f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.106809 May 26 21:50:39.250076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1197/2405] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:39.518442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:39.522483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:39.528539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:39.529153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:39.530190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:39.531409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:39.776515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:39.784678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9aa137cc-70e1-4513-9923-c038b79fb206 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.270821 May 26 21:50:39.785264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1209/2406] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:40.266871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:40.272374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:40.273951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:40.274398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:40.275144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:40.275599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:40.337591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:40.345691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0f2e2437-dcd1-4417-911f-cebe911aa52c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082625 May 26 21:50:40.346490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1198/2407] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:40.802555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:40.803171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:40.810259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:40.810713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:40.811470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:40.811909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:40.944452 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:40.955139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0ec4582b-5fa4-4131-8166-1d3eb1a67da8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156464 May 26 21:50:40.965982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1210/2408] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:41.363374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:41.363941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:41.371090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:41.371812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:41.372622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:41.373071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:41.436701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:41.444855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ca58bec4-2bf8-4f35-87de-e72f58bf75b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085352 May 26 21:50:41.445828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1199/2409] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:41.973785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:41.974653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:41.981746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:41.982201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:41.982960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:41.983388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:42.118603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:42.127393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0626150-d787-4cd0-89a5-85ad9325fd5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.158057 May 26 21:50:42.127954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1211/2410] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:42.463624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:42.464226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:42.470787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:42.471237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:42.471992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:42.472427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:42.540466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:42.549173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-15a10da2-6220-4e79-ad4d-6fe97ce1a119 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089399 May 26 21:50:42.549744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1200/2411] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:43.144853 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:43.145482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:43.151984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:43.152437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:43.153241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:43.153681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:43.284135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:43.292654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e7bd2cb1-f44c-40be-bedf-dcd9a2c446eb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151675 May 26 21:50:43.293544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1212/2412] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:43.566281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:43.566909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:43.574270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:43.574728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:43.575520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:43.576038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:43.638966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:43.646976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-369090c1-3dd6-4fe0-bfe9-19c2adcc3f03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084781 May 26 21:50:43.647548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1201/2413] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:44.310944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:44.311589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:44.318207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:44.318658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:44.319423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:44.319864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:44.447945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:44.455872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-81fd89a5-3a9e-4f15-b91d-2ba45d1b897c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149565 May 26 21:50:44.456440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1213/2414] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:44.664416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:44.665026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:44.672212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:44.672693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:44.673464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:44.673906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:44.735131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:44.743103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-363c3113-2477-448d-893a-23974664a292 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082675 May 26 21:50:44.743662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1202/2415] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:45.473551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:45.474161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:45.480711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:45.481165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:45.481928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:45.482366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:45.612556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:45.621603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-35eabc48-1900-4575-bf7e-2643435dc21b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151658 May 26 21:50:45.622179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1214/2416] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:45.760230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:45.760883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:45.767439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:45.767921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:45.768767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:45.769207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:45.832912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:45.840855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-084be862-9c23-4802-9bfa-2f0afb088dcb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084522 May 26 21:50:45.841427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1203/2417] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:46.639782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:46.640406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:46.647134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:46.647590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:46.648354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:46.648826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:46.776614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:46.784517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bcfaa528-386b-4891-8d5a-f5fe2599533e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149200 May 26 21:50:46.785104 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1215/2418] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:46.857706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:46.858245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:46.864683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:46.865137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:46.865898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:46.866334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:46.928734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:46.937189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2697cae7-c239-4fc0-9158-59f3ebc36455 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083421 May 26 21:50:46.937758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1204/2419] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:47.801925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:47.802566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:47.809297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:47.809751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:47.810525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:47.810966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:47.942311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:47.950920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6c8af74c-489b-4361-9806-d8980c7e6413 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152855 May 26 21:50:47.951482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1216/2420] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:47.954867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:47.955621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:47.962261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:47.962721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:47.964051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:47.964534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:48.026379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:48.028545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:48.034733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b02fce1-c7bd-4e0b-a6e8-ce16293c92d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083966 May 26 21:50:48.035296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1205/2421] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:48.968253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:48.968824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:48.974920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:48.975372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:48.976134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:48.976568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:49.058608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:49.059457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:49.066483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:49.066952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:49.067717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:49.068165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:49.115706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:49.124562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-503bd099-fa2e-4a12-849d-616040675053 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.160439 May 26 21:50:49.125166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1217/2422] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:49.132544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:49.141173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b486f22a-aa75-46cc-9899-52434b89c2a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087024 May 26 21:50:49.141745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1206/2423] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:50.142082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:50.144847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:50.149532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:50.149985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:50.150791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:50.151787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:50.158051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:50.158787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:50.165342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:50.165788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:50.166595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:50.167028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:50.250791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:50.258618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-018898bb-79b8-4349-a8d0-e6935450d179 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.104337 May 26 21:50:50.259184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1207/2424] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:50.309681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:50.317596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4d823aae-ff6e-4455-b817-bf9dc627b599 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.179339 May 26 21:50:50.318154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1218/2425] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:51.277337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:51.277992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:51.284609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:51.289719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:51.289719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:51.289719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:51.335305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:51.336020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:51.342991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:51.343445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:51.344218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:51.344688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:51.347509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:51.356241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-23810e75-2a2f-49d1-812a-3e429d8e16fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083593 May 26 21:50:51.357060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1208/2426] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:51.475122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:51.483898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b857ce8e-7da9-4fde-945c-980f2e10c5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152448 May 26 21:50:51.484713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1219/2427] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:50:52.373659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:52.374282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:52.380841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:52.381296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:52.382053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:52.382490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:52.444129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:52.452217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-671f0cd7-0a34-4a7b-ae31-9adc90b7ee67 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083163 May 26 21:50:52.452830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1209/2428] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:52.501745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:52.502361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:52.508831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:52.509283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:52.510049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:52.510484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:52.637608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:52.645966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a71de4c-bad7-48e3-8227-8f35915df1d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147696 May 26 21:50:52.646365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1220/2429] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:53.469064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:53.469724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:53.476414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:53.477010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:53.477784 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:53.478229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:53.546627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:53.554682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-679805a5-8d5f-4d24-adc2-1ea8442be1f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089717 May 26 21:50:53.555269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1210/2430] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:53.662821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:53.663450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:53.670675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:53.671131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:53.671903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:53.672344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:53.676686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:53.799884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:53.807772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f1021f8c-5e58-4f5a-a69c-32260f604a82 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148817 May 26 21:50:53.808336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1221/2431] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:54.571437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:54.572093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:54.578909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:54.579370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:54.580144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:54.580587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:54.642374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:54.650184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3f8c9543-4292-47ca-9ebc-901ec2f7c1c1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082783 May 26 21:50:54.650897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1211/2432] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:54.825018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:54.825587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:54.832077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:54.832530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:54.833323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:54.833762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:55.220004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:55.228446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e0cc77a0-9396-477e-8ccf-5850d93fbf26 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.407366 May 26 21:50:55.229643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1222/2433] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:55.667305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:55.667925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:55.674615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:55.675076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:55.675840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:55.676281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:55.737338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:55.746014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5f717614-1a17-4cae-9086-916fcdc2a949 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082389 May 26 21:50:55.746592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1212/2434] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:56.247189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:56.247810 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:56.254330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:56.254786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:56.255552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:56.255994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:56.385018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:56.392938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-70ae5d60-1bf3-4113-b7c4-eb7cd6196e99 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150509 May 26 21:50:56.393508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1223/2435] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:56.763462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:56.764085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:56.770606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:56.771064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:56.771829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:56.772275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:56.835271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:56.843895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-00fde298-3055-41a9-855c-43719f6cff43 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084858 May 26 21:50:56.844470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1213/2436] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:57.410541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:57.411162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:57.417826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:57.418281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:57.419036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:57.419476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:57.549777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:57.558517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ccd9beda-9cca-44e6-b61c-e55e8ca9b232 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151799 May 26 21:50:57.559096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1224/2437] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:57.860911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:57.861527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:57.867567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:57.868016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:57.868799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:57.869843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:57.930491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:57.938417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-14bb27a0-d0c0-4073-b938-884033120513 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081589 May 26 21:50:57.938987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1214/2438] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:58.575920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:58.576541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:58.578893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:50:58.583743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:58.584195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:58.585340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:58.585787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:58.718735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:58.726668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a5c1882-2842-4865-ac83-6b1c542890c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155214 May 26 21:50:58.727228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1225/2439] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:58.955511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:58.956108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:58.962562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:58.963018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:58.963812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:58.964255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:59.025719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:59.034201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6622764d-def4-4a69-82be-7e6d1fe54cff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082407 May 26 21:50:59.034774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1215/2440] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:50:59.743652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:50:59.744303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:50:59.751111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:59.751563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:59.752331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:50:59.752806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:50:59.879258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:50:59.888091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b198bcc0-7f80-4515-af05-a256bc4c7b71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148648 May 26 21:50:59.888673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1226/2441] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:50:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:00.051495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:00.052110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:00.058675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:00.059130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:00.059892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:00.060335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:00.123900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:00.131815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-62af4189-ba35-4b99-9775-f71fc3fb8f4a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084167 May 26 21:51:00.132383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1216/2442] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:00.905938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:00.906523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:00.912917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:00.913365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:00.914109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:00.914543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:01.043374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:01.051404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4759b643-98f4-4d87-9ef4-bd6bc8009347 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149381 May 26 21:51:01.052022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1227/2443] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:01.149593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:01.150741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:01.157428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:01.157800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:01.158564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:01.159005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:01.222631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:01.231727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eb55d6a7-4b3c-49d4-873a-9461b247acfe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086121 May 26 21:51:01.232312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1217/2444] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:01.585598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:51:01.585816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:51:02.069154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:02.069773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:02.077311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:02.077760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:02.078515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:02.078946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:02.211716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:02.220354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bc680cc6-29a0-45a8-8d1e-4545db5c7f34 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155439 May 26 21:51:02.220968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1228/2445] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:02.248366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:02.249143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:02.255799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:02.256246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:02.257038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:02.257471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:02.318740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:02.327144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a1ede6a6-0f6d-4573-82fa-5d65441d988b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083003 May 26 21:51:02.327639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1218/2446] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:03.237303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:03.237940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:03.244428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:03.244918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:03.245940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:03.246380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:03.344610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:03.345328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:03.351764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:03.352231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:03.353032 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:03.354058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:03.374546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:03.382795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5e59a6d4-1a52-41dc-90d3-c3f740987142 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149281 May 26 21:51:03.383733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1229/2447] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:03.424277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:03.432489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ddf277b6-3a34-4799-8e6f-cc9a2fed8f2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091765 May 26 21:51:03.433095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1219/2448] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:04.400312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:04.400986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:04.407511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:04.407966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:04.408767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:04.409209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:04.449895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:04.450494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:04.457310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:04.457762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:04.458529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:04.458965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:04.525888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:04.534087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2ce808fe-bcba-4383-a52b-f19131ccc8a7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088031 May 26 21:51:04.534669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1220/2449] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:04.562192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:04.570442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f96154e4-09d2-4734-8feb-db53b9d68c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.174072 May 26 21:51:04.571014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1230/2450] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:05.551352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:05.552003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:05.559388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:05.559885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:05.560604 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:05.561068 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:05.587210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:05.587813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:05.594775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:05.595229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:05.595996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:05.596434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:05.624370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:05.632661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-52b714f1-1824-48c3-b310-5a2ce667367e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085149 May 26 21:51:05.633336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1221/2451] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:05.730147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:05.738205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71de4349-6a38-4882-943f-23f89cec7d4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154887 May 26 21:51:05.738774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1231/2452] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:06.650349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:06.651611 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:06.654072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=56 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:06.658897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:06.659408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:06.660185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:06.660660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:06.675834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:06.724105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:06.732052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7127323d-c8a1-4134-acd0-129dff9fae3e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085636 May 26 21:51:06.732635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1222/2453] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:06.755023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:06.755644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:06.762650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:06.763096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:06.763849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:06.764291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:06.889944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:06.897882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c97c82d6-b9a1-44b0-9be8-52622328db49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146656 May 26 21:51:06.898449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1232/2454] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:07.749918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:07.750570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:07.757087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:07.757542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:07.758309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:07.758750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:07.827313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:07.835727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a3f21097-70e6-4b52-b5d0-29ef4e04eb8b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090052 May 26 21:51:07.836292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1223/2455] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:07.914221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:07.914832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:07.921435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:07.921897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:07.922639 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:07.923079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:08.051355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:08.060020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e4ef086a-3e33-464b-840f-74cffe79e7b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149681 May 26 21:51:08.060621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1233/2456] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:08.852746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:08.853328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:08.859992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:08.860443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:08.861228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:08.861665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:08.922577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:08.930579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5459d1d4-1cf9-454e-a432-79a5abf89f5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081824 May 26 21:51:08.931146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1224/2457] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:09.077920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:09.078538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:09.085088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:09.085541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:09.086305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:09.086746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:09.217367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:09.225449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bd8fb82d-4b2c-4ea8-b867-eaac012707d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152113 May 26 21:51:09.226024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1234/2458] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:09.948182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:09.948801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:09.956160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:09.956624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:09.957390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:09.957829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:10.020380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:10.028656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9918bab8-6653-43d3-89dc-2ba9dc2d8e0e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084390 May 26 21:51:10.029232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1225/2459] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:10.242520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:10.243169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:10.250531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:10.250974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:10.251725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:10.252153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:10.379651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:10.387625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1cecafb8-c967-4ae4-b057-59862d931254 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148871 May 26 21:51:10.388215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1235/2460] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:11.044834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:11.045480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:11.053482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:11.056903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:11.056903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:11.056903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:11.120009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:11.129203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3d5d939e-adce-4c53-8848-2e1798ad017b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088295 May 26 21:51:11.129814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1226/2461] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:11.404740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:11.405334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:11.411780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:11.412233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:11.413017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:11.413456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:11.543994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:11.552005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-637dcdcf-4241-4c72-b4aa-aa025155203a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151117 May 26 21:51:11.552611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1236/2462] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:11.886147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:51:11.886384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:51:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:51:12.146485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:12.147154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:12.154015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:12.154463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:12.155219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:12.155754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:12.217515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:12.225519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24dd11b3-0799-4e59-bc80-2b5a596038a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083035 May 26 21:51:12.226076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1227/2463] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:12.569402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:12.570017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:12.577668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:12.578119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:12.578890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:12.579333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:12.712167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:12.716179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:12.720911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a12b7a44-422e-4e10-9e04-fb07cd2634ad tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155439 May 26 21:51:12.721468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1237/2464] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:13.243278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:13.243885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:13.251338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:13.251798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:13.252568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:13.253033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:13.314003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:13.321872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3ecf8e3e-af40-43ee-9eb7-f55c49733ba7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082541 May 26 21:51:13.322429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1228/2465] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:13.738280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:13.738896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:13.746018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:13.746472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:13.747229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:13.747668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:13.874456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:13.882557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ccd08b45-6da0-4a6d-a14e-b2c51884ae94 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148224 May 26 21:51:13.883135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1238/2466] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:14.338654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:14.339267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:14.345855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:14.346302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:14.347055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:14.347490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:14.411732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:14.419703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c86ad035-9517-4c06-804f-4aa085086b36 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084906 May 26 21:51:14.420264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1229/2467] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:14.899462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:14.900359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:14.907526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:14.907974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:14.908803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:14.909240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:15.037722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:15.045859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b19c45fc-7a02-4d5e-970d-539908828d7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150247 May 26 21:51:15.046442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1239/2468] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:15.436435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:15.437072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:15.443654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:15.444049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:15.444925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:15.445298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:15.508467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:15.516460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-abf4758d-148d-4ded-afac-2535e8f8828f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084537 May 26 21:51:15.517057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1230/2469] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:16.063030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:16.063688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:16.070219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:16.070671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:16.071470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:16.071911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:16.203102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:16.211073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a0dbc3a4-7090-44ed-bfbc-f182c1f6aea1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152103 May 26 21:51:16.211626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1240/2470] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:16.533399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:16.534035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:16.540605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:16.541052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:16.541866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:16.542306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:16.608426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:16.616690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7770a90d-da3e-4387-b445-cf5c1edc76fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087712 May 26 21:51:16.617264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1231/2471] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:17.228948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:17.229552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:17.236047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:17.236490 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:17.237274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:17.237700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:17.364002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:17.372095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a38c1f9-762b-4667-a7e5-b96ecc0d56f2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147004 May 26 21:51:17.373210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1241/2472] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:17.634389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:17.635042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:17.642427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:17.642884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:17.643663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:17.644094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:17.714007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:17.722159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7dc78966-4e6b-4b67-ae3c-dc364b461bbf tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091582 May 26 21:51:17.722741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1232/2473] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:18.390301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:18.390901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:18.397588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:18.398045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:18.398815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:18.399251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:18.526521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:18.534558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ba2f8b8-0ffe-40ba-a2bb-ae10f0ac3154 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148694 May 26 21:51:18.535131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1242/2474] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:18.740011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:18.740640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:18.748305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:18.748789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:18.749543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:18.749976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:18.810592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:18.818886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a0a344f6-a725-4883-a8c1-c9f0279deb2b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082693 May 26 21:51:18.819455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1233/2475] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:19.551342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:19.551996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:19.559212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:19.560725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:19.560960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:19.561398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:19.693750 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:19.702494 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0b3c30e1-0bab-44fc-923b-7a88cd718f9b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155097 May 26 21:51:19.703066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1243/2476] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:19.835096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:19.835728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:19.842234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:19.842702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:19.843462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:19.843897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:19.904608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:19.912470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-811f4ac8-b923-44bd-be8b-d5042bfc2b58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081222 May 26 21:51:19.913066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1234/2477] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:20.726946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:20.727593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:20.734139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:20.734593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:20.735389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:20.735830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:20.867326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:20.875556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d606d252-a6cd-40d7-ad40-8a284157df4e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152490 May 26 21:51:20.876120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1244/2478] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:20.930063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:20.930684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:20.937283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:20.937737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:20.938499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:20.938938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:21.003392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:21.011685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1b06b1c8-6b5b-4947-a927-dd96b24dda2e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085443 May 26 21:51:21.012256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1235/2479] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:21.892986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:21.893584 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:21.899981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:21.900425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:21.901205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:21.901634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:22.029600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:22.030858 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:22.033680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:22.037643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:22.038178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:22.039026 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:22.039563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:22.041753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-151c4f7c-f49d-4500-8657-c6285bb2260c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152783 May 26 21:51:22.042318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1245/2480] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:22.102905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:22.111363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-615845a9-abe4-4bdf-ac54-64e9dc930916 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085649 May 26 21:51:22.111944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1236/2481] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:23.059506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:23.060564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:23.067793 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:23.068247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:23.069042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:23.069487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:23.129150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:23.129830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:23.136223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:23.136709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:23.137470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:23.137910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:23.202489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:23.210317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4125c7c3-ab3d-4a8d-85e7-b5e00f83c2f6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085056 May 26 21:51:23.210887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1237/2482] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:23.223398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:23.231313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9673b350-c307-4277-956a-20a4bfae9fb4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.175860 May 26 21:51:23.231878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1246/2483] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:24.226907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:24.227516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:24.234243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:24.234700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:24.235461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:24.235907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:24.250195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:24.250812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:24.257235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:24.257686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:24.258456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:24.258879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:24.301035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:24.309691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-447f601a-2a05-49f3-b552-c399830cc353 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086517 May 26 21:51:24.310273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1238/2484] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:24.394270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:24.402264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-12b6a91d-e121-4fab-b680-a022cdeb37fb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156574 May 26 21:51:24.402839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1247/2485] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:25.326642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:25.327755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:25.334341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:25.334798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:25.335558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:25.335994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:25.338537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:25.400712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:25.409150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-71cfd4ae-715e-4fed-8088-4238c1316908 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086459 May 26 21:51:25.409712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1239/2486] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:25.419009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:25.419658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:25.426484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:25.426937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:25.427701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:25.428143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:25.556610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:25.565204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-efe8eff5-2e08-40ff-af6b-7258ba295d88 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149979 May 26 21:51:25.565778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1248/2487] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:26.426426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:26.427040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:26.433506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:26.433956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:26.434715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:26.435159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:26.495592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:26.504034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-359240cb-f8ef-49d1-9bda-771ef8039cb4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081593 May 26 21:51:26.504602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1240/2488] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:26.583218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:26.583839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:26.590483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:26.590930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:26.591700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:26.592139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:26.723226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:26.731098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-06e3a374-d960-4db0-b876-04ecf789bbb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152775 May 26 21:51:26.731660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1249/2489] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:27.521562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:27.522204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:27.528323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:27.528832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:27.529615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:27.530060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:27.591921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:27.602365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-101e8d41-86d1-43f1-8d84-eb7b52bb4c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084824 May 26 21:51:27.602954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1241/2490] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:27.749278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:27.749876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:27.756984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:27.757457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:27.758236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:27.758672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:27.889102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:27.897655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-acacfaf7-e996-43ea-a7b7-976fb683524a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152532 May 26 21:51:27.898230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1250/2491] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:28.620815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:28.621434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:28.628156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:28.628646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:28.629415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:28.629857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:28.694502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:28.702507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7997a8be-9d90-4a8f-9067-ec410de51084 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086151 May 26 21:51:28.703080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1242/2492] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:28.915023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:28.915583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:28.918009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=52 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:28.923278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:28.923725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:28.924485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:28.924946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:29.051861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:29.059824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f1778b75-c27f-41c1-af42-169cfb48f863 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148771 May 26 21:51:29.060462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1251/2493] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:29.719938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:29.720803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:29.727155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:29.727613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:29.728381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:29.728851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:29.792016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:29.799836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-40081112-687b-4617-b484-17e0fb70a55c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084549 May 26 21:51:29.800396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1243/2494] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:30.077986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:30.079254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:30.085854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:30.086328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:30.087073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:30.087515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:30.215805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:30.223743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-24b21586-0d83-4516-ad05-0465b5eb2e47 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149622 May 26 21:51:30.224305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1252/2495] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:30.816693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:30.817240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:30.823832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:30.824290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:30.825087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:30.825531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:30.886010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:30.894001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cfe3b3b6-3de8-410e-ac6d-bd5517e985fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081313 May 26 21:51:30.894571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1244/2496] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:31.241069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:31.241671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:31.248486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:31.248962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:31.249757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:31.250231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:31.378539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:31.386440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e406624-4d48-441d-9edc-5ba4fb1dab3b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149276 May 26 21:51:31.387009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1253/2497] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:31.911516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:31.912083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:31.918581 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:31.919031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:31.919791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:31.920227 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:31.984015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:31.992025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-befc17d0-6a0f-42c4-b8c5-4681930404f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084494 May 26 21:51:31.992614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1245/2498] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:32.403710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:32.404313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:32.411034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:32.411492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:32.412267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:32.412739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:32.430394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:32.543300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:32.551775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b28e59ae-7602-40ff-a963-2fe18ff24be3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151423 May 26 21:51:32.552353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1254/2499] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:33.009104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:33.009712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:33.016208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:33.016694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:33.017466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:33.017908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:33.080326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:33.088510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-206310cc-ad27-4f82-8a6f-0f7dd7fdf4fa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083246 May 26 21:51:33.089125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1246/2500] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:33.569116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:33.569757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:33.576371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:33.576848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:33.577611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:33.578044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:33.713682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:33.721632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2aae3529-aeff-44aa-a740-208f644319b4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156374 May 26 21:51:33.722215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1255/2501] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:34.105603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:34.106255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:34.112844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:34.113301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:34.114564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:34.115007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:34.177496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:34.185402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8606aa86-e4d9-4b70-9dbb-7266e3b50f3c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083652 May 26 21:51:34.185964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1247/2502] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:34.739437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:34.740181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:34.747033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:34.747470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:34.748220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:34.748679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:34.876373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:34.884361 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3d525cf2-4df1-49d1-8400-dee7c295320b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149426 May 26 21:51:34.884959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1256/2503] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:35.206632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:35.206632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:35.209416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:35.209876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:35.210647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:35.211097 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:35.275242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:35.283320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1a4a8881-f00b-4a27-b47d-945b8c772c4b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085745 May 26 21:51:35.283882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1248/2504] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:35.901695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:35.902257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:35.908775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:35.909232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:35.909992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:35.910936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:36.045569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:36.053925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d426593c-bba8-4994-9f81-4f9956527dca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156161 May 26 21:51:36.054488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1257/2505] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:36.299983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:36.300619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:36.307156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:36.307607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:36.308371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:36.308839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:36.369751 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:36.377519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-021bee99-f80b-4e29-9189-76545e5d3a4f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081378 May 26 21:51:36.378077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1249/2506] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:37.071735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:37.072406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:37.078919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:37.079378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:37.080130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:37.080573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:37.211525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:37.219607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9da53d24-e84c-428e-b122-a360b2ad16dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151765 May 26 21:51:37.224446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1258/2507] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:37.393993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:37.394568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:37.396882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=56 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:37.401990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:37.402438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:37.403189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:37.403623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:37.466846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:37.475255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bff8b81f-4370-4158-89e0-855d4bc30205 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085158 May 26 21:51:37.475814 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1250/2508] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:38.236920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:38.237565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:38.244139 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:38.244888 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:38.245646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:38.246125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:38.373811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:38.382218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-859372ca-2cf9-4ace-b7d7-9c2792817084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149218 May 26 21:51:38.382788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1259/2509] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:38.492754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:38.493376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:38.500105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:38.500558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:38.501354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:38.501797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:38.568341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:38.576469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4e97684a-44f5-455f-bdaa-9d6e72d0f329 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088136 May 26 21:51:38.577089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1251/2510] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:39.399326 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:39.399936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:39.406634 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:39.407085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:39.407843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:39.408281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:39.536722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:39.545520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2cd04cc3-4ff1-4dd5-8d23-e78b0b482c57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150528 May 26 21:51:39.546093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1260/2511] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:39.593905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:39.595527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:39.601430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:39.601972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:39.602859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:39.603367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:39.665747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:39.673799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-195f5a6f-e22e-4853-9497-8495844989a4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083888 May 26 21:51:39.674370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1252/2512] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:40.562824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:40.563447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:40.570213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:40.570711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:40.571466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:40.571907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:40.691089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:40.694165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:40.698965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:40.699419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:40.700279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:40.700743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:40.706478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:40.715926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8016354e-35e1-4560-8c8b-e615e401caac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.157123 May 26 21:51:40.727044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1261/2513] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:40.767327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:40.776574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ff6439de-fa90-42f6-a495-d78738086da5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089318 May 26 21:51:40.778703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1253/2514] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:41.734997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:41.735589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:41.742397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:41.742850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:41.743609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:41.744050 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:41.794714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:41.795316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:41.801823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:41.802287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:41.803098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:41.803555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:41.874199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:41.882742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-527591b4-255f-4343-b1b0-0ebefe651ae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091837 May 26 21:51:41.883318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1254/2515] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:41.895748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:41.904309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7b27bf73-3700-426c-807f-ef40282ee4d0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.173233 May 26 21:51:41.905216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1262/2516] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:42.899894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:42.900459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:42.906995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:42.907491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:42.908253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:42.908727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:42.921674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:42.922296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:42.929353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:42.929805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:42.930570 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:42.931007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:42.977203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:42.979433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:42.986014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d60997d7-972d-4ddb-a76d-c7fad75c66ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090102 May 26 21:51:42.986602 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1255/2517] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:43.071258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:43.079110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-72ac74c6-9392-4c5d-b4d1-70a119edf8c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.161234 May 26 21:51:43.079674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1263/2518] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:44.003419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:44.004037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:44.011510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:44.011992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:44.012769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:44.013199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:44.077467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:44.085422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-674e5ecb-c4e0-422b-8a2e-98ab07cbc106 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086019 May 26 21:51:44.085998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1256/2519] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:44.096466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:44.097479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:44.104207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:44.104679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:44.105442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:44.105884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:44.235458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:44.244131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1e8cd3d8-dd83-42e0-b96b-ee594e8cccaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151533 May 26 21:51:44.244997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1264/2520] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:45.102265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:45.102871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:45.109503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:45.109957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:45.110713 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:45.111152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:45.171838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:45.179728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-87c434c3-77ac-456b-8616-06725a1e03f0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081320 May 26 21:51:45.180293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1257/2521] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:45.262273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:45.262894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:45.269509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:45.269962 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:45.270733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:45.271176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:45.398101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:45.406037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a57e2ec7-e9d0-4d69-ae8d-6b7d0744853f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148349 May 26 21:51:45.406603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1265/2522] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:46.197449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:46.198064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:46.204702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:46.205160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:46.205938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:46.206378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:46.271838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:46.280808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-46e89f4d-80af-402b-9ec0-4da0929169b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087335 May 26 21:51:46.281381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1258/2523] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:46.423345 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:46.423967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:46.430548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:46.431000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:46.431764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:46.432209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:46.559375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:46.567369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f90def83-17ba-42b6-b149-8af30c31f7a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147972 May 26 21:51:46.567930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1266/2524] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:47.298662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:47.299308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:47.306448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:47.306898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:47.307653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:47.308092 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:47.367714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:47.376441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-35bc6e44-6074-42c0-9584-e81e13587e59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081714 May 26 21:51:47.377034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1259/2525] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:47.585043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:47.585693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:47.592904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:47.593366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:47.594125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:47.594566 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:47.725348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:47.734022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-087abb7f-264a-4a3d-94eb-d2e0c8e581b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152807 May 26 21:51:47.734592 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1267/2526] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:48.393508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:48.394115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:48.401170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:48.401628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:48.402389 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:48.402829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:48.463099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:48.471036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2392ba50-1b71-4f45-a6cc-d81170291cb1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081461 May 26 21:51:48.471626 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1260/2527] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:48.751321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:48.751946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:48.758178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:48.759132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:48.759891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:48.760336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:48.894065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:48.903095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-34bd7d42-8e8f-4e8d-bbac-c111444b6835 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155607 May 26 21:51:48.903693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1268/2528] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:49.488615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:49.489256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:49.496816 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:49.497268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:49.498038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:49.498477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:49.562738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:49.570714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2820fdf1-fce4-485d-abd8-2aad0700238c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086051 May 26 21:51:49.571285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1261/2529] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:49.921399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:49.921968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:49.928534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:49.929020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:49.929785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:49.930230 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:50.060170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:50.068121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8fc7f360-992d-441b-80ad-906ea9f59d4f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150784 May 26 21:51:50.068710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1269/2530] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:50.587919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:50.588537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:50.595282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:50.595734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:50.596498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:50.596982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:50.660980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:50.669116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e27ff006-9694-4499-92e1-715929d11d3a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085100 May 26 21:51:50.669705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1262/2531] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:51.086242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:51.086871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:51.093495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:51.093951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:51.094724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:51.095165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:51.231860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:51.239961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b3474b6d-9a38-44b5-b1ff-3637d90aaa69 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.157945 May 26 21:51:51.240533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1270/2532] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:51.686181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:51.686824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:51.693438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:51.693887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:51.694639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:51.695236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:51.756552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:51.765033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-24dbaa34-cc98-470f-a43d-c3e359194b87 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082762 May 26 21:51:51.765593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1263/2533] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:52.257683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:52.258307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:52.265021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:52.265481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:52.266242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:52.266682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:52.270595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:52.393806 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:52.402120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b9959e85-2d3e-4b6a-aaaf-f14116912212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148447 May 26 21:51:52.402698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1271/2534] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:52.782325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:52.782955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:52.789426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:52.790368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:52.791134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:52.791569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:52.854772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:52.862732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fed503b0-3625-454a-9f3b-19cb97eaed29 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084236 May 26 21:51:52.863304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1264/2535] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:53.419951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:53.420623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:53.427337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:53.427790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:53.428567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:53.429040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:53.557264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:53.565485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c9b25af3-55b1-4362-b206-18798b5b996b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149358 May 26 21:51:53.566052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1272/2536] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:51:53.880718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:53.881339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:53.888661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:53.889149 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:53.889919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:53.890403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:53.951347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:53.959376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c2a1c6e7-0ee0-4bd7-9240-2717662afe5d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082628 May 26 21:51:53.959949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1265/2537] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:54.583362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:54.583970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:54.591261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:54.591719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:54.592488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:54.592961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:54.724002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:54.732742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bbdef422-9eb3-4bdc-8bd6-5f33d6ed7f1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153175 May 26 21:51:54.733311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1273/2538] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:54.976404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:54.976980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:54.983461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:54.983907 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:54.984696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:54.985127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:55.046835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:55.054834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c6e65544-a096-499a-9f97-3bfb2b74fbfd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082445 May 26 21:51:55.055406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1266/2539] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:55.750470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:55.751095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:55.757615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:55.758077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:55.758884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:55.759325 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:55.886923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:55.894847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ccdb025b-8769-46f5-8e2e-eb24701a641f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148306 May 26 21:51:55.895417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1274/2540] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:56.071318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:56.072143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:56.078548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:56.079000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:56.079759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:56.080201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:56.146146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:56.154655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dcf3bafe-0546-4616-9fb5-fc75eb3424b6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087299 May 26 21:51:56.155216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1267/2541] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:56.912253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:56.912830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:56.919211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:56.919657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:56.920415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:56.920875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:57.047385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:57.055976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8efac3c3-9dae-497f-aad6-a63fed20ff61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147699 May 26 21:51:57.056826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1275/2542] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:57.171573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:57.172157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:57.178208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:57.178665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:57.179421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:57.179863 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:57.239767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:57.248549 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-715bab28-640a-4798-bbf4-f80f92d608e9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081142 May 26 21:51:57.249144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1268/2543] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:58.074187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:58.074792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:58.081493 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:58.081946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:58.082705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:58.083140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:58.214438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:58.222324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-836928c9-09ec-479c-95dc-3c3e39b33a71 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152102 May 26 21:51:58.222897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1276/2544] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:58.265239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:58.265856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:58.272312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:58.272800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:58.273562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:58.273999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:58.337490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:58.345497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b7dcd26a-694d-4a8b-9926-3e5eea6e6ca6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084077 May 26 21:51:58.346069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1269/2545] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:59.240447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:59.241094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:59.243418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=52 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:51:59.248497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:59.248979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:59.249757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:59.250188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:59.361846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:51:59.362452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:51:59.369257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:59.369711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:59.370481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:51:59.370919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:51:59.380254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:59.391145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e852f551-7525-4a27-9e1f-6f607579b2b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154649 May 26 21:51:59.391729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1277/2546] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:51:59.435438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:51:59.443564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5dc958d-5588-4ff6-a5d5-74367eda0af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085523 May 26 21:51:59.444135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1270/2547] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:51:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:00.409237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:00.409948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:00.417045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:00.417501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:00.418268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:00.418704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:00.461172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:00.461820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:00.468269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:00.468761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:00.469524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:00.469966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:00.540509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:00.548603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3d021a22-f301-4a5e-8ed7-5ab23c45f717 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091230 May 26 21:52:00.549189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1271/2548] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:00.570205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:00.578851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e48982bd-851b-47c0-8093-b58147f5d1a3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.173405 May 26 21:52:00.579445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1278/2549] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:01.566142 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:01.566927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:01.574106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:01.574568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:01.575497 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:01.575789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:01.591035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:01.597555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:01.598285 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:01.606237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:01.606694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:01.607481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:01.607956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:01.640780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:01.649078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-317de267-a6ed-4f3c-8f06-643de7fc02c4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086765 May 26 21:52:01.649663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1272/2550] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:01.743958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:01.752178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f17d2009-5aa4-4d2a-bce1-d829172d7373 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.158701 May 26 21:52:01.752775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1279/2551] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:02.666730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:02.667512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:02.673996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:02.674448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:02.675233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:02.675665 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:02.736965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:02.745630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e40cf939-0eec-4e07-8225-81c1a9f5eb97 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083457 May 26 21:52:02.746205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1273/2552] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:02.769302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:02.769911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:02.776310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:02.776789 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:02.777543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:02.777974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:02.903652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:02.911635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9397ce26-5880-4723-b60b-99d7c9048758 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146103 May 26 21:52:02.912211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1280/2553] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:03.763071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:03.763679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:03.770179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:03.770634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:03.771397 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:03.771839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:03.834690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:03.842840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-573d1d28-9da3-43fb-81c6-06748a75cbc8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084280 May 26 21:52:03.843412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1274/2554] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:03.929501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:03.930112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:03.937474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:03.937917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:03.938681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:03.939112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:04.065124 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:04.073095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-06607e8a-85fe-452a-9b21-dae2ee49358b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147386 May 26 21:52:04.073664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1281/2555] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:04.859699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:04.860277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:04.866768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:04.867226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:04.867990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:04.868485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:04.929504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:04.937479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ac8c653e-7328-4fb2-9e8c-640588533e26 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081770 May 26 21:52:04.938050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1275/2556] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:05.090290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:05.090913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:05.097532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:05.097977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:05.098730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:05.099164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:05.229171 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:05.237159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c537eabc-a0f6-4baa-b846-ec25f41e0083 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150767 May 26 21:52:05.237730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1282/2557] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:05.955436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:05.955994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:05.962977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:05.963432 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:05.964183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:05.964638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:06.026903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:06.034796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5d6fd941-86f4-40be-8783-c3f58b620c09 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083364 May 26 21:52:06.035358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1276/2558] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:06.254895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:06.255509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:06.262559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:06.263002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:06.263755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:06.264187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:06.392092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:06.400653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-414a76d8-fdda-43d9-b088-3575b8176622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149020 May 26 21:52:06.401232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1283/2559] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:07.052311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:07.052966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:07.059554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:07.060009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:07.060802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:07.061245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:07.129156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:07.137672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1150c2e5-581c-42a5-aa82-fbca02d880aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089159 May 26 21:52:07.138246 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1277/2560] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:07.418065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:07.418638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:07.425193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:07.425644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:07.426406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:07.426851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:07.554323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:07.562838 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8f31ae4e-9695-4950-b873-0b0316313497 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148735 May 26 21:52:07.563422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1284/2561] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:08.154609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:08.155238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:08.157591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=56 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:08.162617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.163221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.164027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.164458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.231795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:08.239908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-376de41a-70df-42cc-8b6f-e83a5d5bef49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089067 May 26 21:52:08.240492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1278/2562] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:08.373689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:08.374190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:08.380220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.380695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.381459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.381895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.395424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 HTTP/1.1 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:52:08.397028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.399032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'de3c1b5f-d433-4d79-b190-8ff620c536b7'} May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:52:08.400649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.402770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:52:08.404529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:52:08.404529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-782e4a69-355a-4925-87a0-9df2c66851f6 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 404 len: 111 microversion: 2.20 time: 0.028607 May 26 21:52:08.404529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1285/2563] 10.222.0.66 () {60 vars in 1279 bytes} [Thu May 26 21:52:08 2022] DELETE /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 21:52:08.408215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:08.408992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: de3c1b5f-d433-4d79-b190-8ff620c536b7] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:08.416028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.416493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.417462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.417908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.431390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 HTTP/1.1 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:52:08.433086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.435221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'de3c1b5f-d433-4d79-b190-8ff620c536b7'} May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:52:08.436607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. May 26 21:52:08.438695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:52:08.440198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance de3c1b5f-d433-4d79-b190-8ff620c536b7 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:52:08.440198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-934565ab-9d6c-466c-8be9-11a50288df9c tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7" status: 404 len: 111 microversion: 2.20 time: 0.030508 May 26 21:52:08.440198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1279/2564] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:52:08 2022] GET /compute/v2.1/servers/de3c1b5f-d433-4d79-b190-8ff620c536b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:52:08.581289 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:08.581843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:08.588808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.589257 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.590018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:08.590450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:08.729242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:08.737363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-474c1a0c-fdb5-4095-b469-350b34512f38 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.159914 May 26 21:52:08.737932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1286/2565] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:09.257685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:09.258296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:09.265317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:09.265829 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:09.266606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:09.267120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:09.327781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:09.336278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2e064b54-3406-4ae0-95d0-b938df9e9e03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082572 May 26 21:52:09.336874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1280/2566] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:09.754614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:09.755222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:09.761886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:09.762338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:09.763099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:09.763542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:10.235716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:10.245143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cf15f261-a77d-4b70-8789-2f8a1536871d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.494344 May 26 21:52:10.245832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1287/2567] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:10.343037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-071fbd87-7c63-40da-9457-c49c326e428b req-5818bc27-f6fb-4701-8543-6bfaf94886fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c371c14f-9d30-4fb1-8986-4ca9550e4fc8", "name": "network-vif-deleted", "tag": "030ae099-94fa-4bf1-83eb-d3e51b6ea090"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:52:10.351600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-071fbd87-7c63-40da-9457-c49c326e428b req-5818bc27-f6fb-4701-8543-6bfaf94886fe service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:10.352051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-071fbd87-7c63-40da-9457-c49c326e428b req-5818bc27-f6fb-4701-8543-6bfaf94886fe service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:10.355060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:10.355060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:10.361449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:10.361979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:10.362834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:10.363328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:10.364494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-071fbd87-7c63-40da-9457-c49c326e428b req-5818bc27-f6fb-4701-8543-6bfaf94886fe service nova] Creating event network-vif-deleted:030ae099-94fa-4bf1-83eb-d3e51b6ea090 for instance c371c14f-9d30-4fb1-8986-4ca9550e4fc8 on hv-cinder-82880 May 26 21:52:10.371154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-071fbd87-7c63-40da-9457-c49c326e428b req-5818bc27-f6fb-4701-8543-6bfaf94886fe service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164509 May 26 21:52:10.371763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1281/2568] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:52:10.382617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:10.428170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:10.436061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9f3b722b-4281-4b57-8741-d498f0adcc9e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086877 May 26 21:52:10.436638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1288/2569] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:11.263331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:11.264041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:11.270740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:11.271194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:11.271956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:11.272399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:11.400507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:11.408364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-db2bfdea-54e3-4855-9db9-7239caa33ea7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149893 May 26 21:52:11.408955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1282/2570] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:11.453090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:11.453711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:11.460360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:11.460850 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:11.461615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:11.462054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:11.527203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:11.534625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-777e9c1e-0a5f-401c-a727-09d0ddb111f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085791 May 26 21:52:11.535191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1289/2571] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:12.426319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:12.427332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:12.434122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:12.434574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:12.435346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:12.435790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:12.551595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:12.552166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:12.560304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:12.560304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:12.561395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:12.561971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:12.572314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:12.581110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aefeb841-9399-4745-9354-e99ea3030b60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.158713 May 26 21:52:12.581898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1283/2572] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:12.630214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:12.638746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-37968f0b-8a4a-4051-a134-dacd39497cbb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091225 May 26 21:52:12.639316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1290/2573] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:13.598596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:13.599220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:13.606399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:13.607222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:13.607996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:13.608448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:13.655295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:13.655918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:13.662767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:13.663226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:13.664004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:13.664446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:13.739126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:13.747349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7214fef6-43f6-405c-8bab-d646d01d43ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.095937 May 26 21:52:13.747914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1291/2574] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:13.760609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:13.768657 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1af1e52d-2fdb-4765-aedd-cf839b6ba84a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.174011 May 26 21:52:13.769217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1284/2575] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:14.763403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:14.764065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:14.771503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:14.771503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:14.771937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:14.772371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:14.786554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:14.787180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:14.794430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:14.794891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:14.795674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:14.796116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:14.847366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:14.856078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a2ee60df-4045-4eb5-9dc2-4d169ba85120 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.096630 May 26 21:52:14.856775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1292/2576] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:14.935795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:14.943712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ec55ce18-05ac-4263-be8e-f1684fdbb885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.161110 May 26 21:52:14.944283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1285/2577] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:15.873738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:15.874290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:15.880786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:15.881229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:15.881973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:15.882405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:15.942843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:15.950690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-95b9f1fb-9334-4243-bc5a-dabcd3b1574e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080856 May 26 21:52:15.951261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1293/2578] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:15.963558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:15.964176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:15.970630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:15.971087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:15.971847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:15.972289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:16.101022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:16.109433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-024f764a-6069-4987-9518-bd3c7d94bffb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150197 May 26 21:52:16.110006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1286/2579] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:16.968463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:16.969048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:16.975674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:16.976120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:16.976921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:16.977409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:17.038535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:17.046489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-08cbac05-b1d1-4cfc-9b6f-6e70f062d81d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082570 May 26 21:52:17.047047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1294/2580] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:17.126739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:17.127353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:17.133888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:17.134338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:17.135098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:17.135537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:17.268198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:17.273011 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fa32ed49-1a2b-4afb-b2b1-fbd176ad283d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149999 May 26 21:52:17.275456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1287/2581] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:18.063784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:18.064401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:18.071168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:18.071620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:18.072390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:18.072865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:18.137465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:18.145422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-046f6aeb-ea14-4d5c-b3b9-c07966a54c15 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085493 May 26 21:52:18.146053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1295/2582] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:18.289711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:18.290908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:18.297423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:18.297872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:18.298632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:18.299073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:18.432887 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:18.441376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8da5299e-a54d-42c7-8c65-11e666a699dc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155451 May 26 21:52:18.441960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1288/2583] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:19.162423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:19.163045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:19.169896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:19.170350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:19.171112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:19.171554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:19.232560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:19.240483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-848271bb-3b12-4d14-a0b2-fa14fa8cc19f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081891 May 26 21:52:19.241081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1296/2584] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:19.459475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:19.460027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:19.467438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:19.467893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:19.468689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:19.469134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:19.600324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:19.609219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9631e68-a147-447a-90f7-d050ad62524c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153736 May 26 21:52:19.609823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1289/2585] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:20.256662 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:20.257300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:20.264246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:20.264725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:20.265474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:20.265904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:20.328489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:20.337232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-efb5249f-4fb5-4c3f-b530-da313bd4154c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083838 May 26 21:52:20.337802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1297/2586] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:20.626917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:20.627529 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:20.634648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:20.635093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:20.635843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:20.636277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:20.653328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:20.766427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:20.774513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-780fff2e-f91b-4717-ac7d-31acf3c52aaf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151529 May 26 21:52:20.775086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1290/2587] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:21.356184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:21.356826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:21.363600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:21.364047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:21.364833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:21.365270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:21.428788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:21.436733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-30c148f9-21ff-4034-8356-28ecb5faa7f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084927 May 26 21:52:21.437300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1298/2588] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:21.791663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:21.792343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:21.798830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:21.799276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:21.800023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:21.800453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:21.927065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:21.935520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d7ccebb2-e697-4406-b3da-09a57319c9a9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147735 May 26 21:52:21.936089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1291/2589] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:22.453840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:22.454481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:22.461167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:22.462281 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:22.463063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:22.463503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:22.524922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:22.532861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-83ca2d69-64ae-4ccf-b97d-63e9c34d4ad2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083005 May 26 21:52:22.533430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1299/2590] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:22.953164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:22.953772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:22.960451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:22.960959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:22.961709 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:22.962148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:23.090387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:23.098275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf71ff6f-b199-4989-b549-9cd1df35b54d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149036 May 26 21:52:23.098847 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1292/2591] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:23.549782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:23.550412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:23.557009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:23.557459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:23.558208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:23.558637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:23.619918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:23.627936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ac9e7df6-161c-43ca-a9f4-9d207659026c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081961 May 26 21:52:23.628504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1300/2592] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:24.114978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:24.115633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:24.122478 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:24.122928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:24.123743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:24.124136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:24.250367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:24.258966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-23870c6f-dcf6-40b2-8fd0-47527c9dd5a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147320 May 26 21:52:24.259532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1293/2593] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:24.644949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:24.645587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:24.652129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:24.652589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:24.653371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:24.653807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:24.718154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:24.726129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15028803-1913-4a12-a89a-e756a3bb73f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085114 May 26 21:52:24.726700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1301/2594] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:25.276647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:25.277276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:25.283749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:25.284205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:25.285076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:25.285524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:25.413717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:25.421943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0af2d19b-6ef7-4e0f-b306-a3868edab57b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149725 May 26 21:52:25.422538 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1294/2595] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:25.744016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:25.744621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:25.751145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:25.751595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:25.752353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:25.752815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:25.813319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:25.821801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f09305fb-fa29-460a-8bbc-146d4d8eae7a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082377 May 26 21:52:25.822365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1302/2596] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:26.439088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:26.439693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:26.446239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:26.446686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:26.447441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:26.447875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:26.578451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:26.587141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3efdec61-ecd3-4deb-b0de-9896c7159ea3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151376 May 26 21:52:26.587715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1295/2597] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:26.839223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:26.839882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:26.846462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:26.846915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:26.847678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:26.848121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:26.911650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:26.919766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-03386870-8b90-44d2-9251-6746d5f1b95b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085021 May 26 21:52:26.920342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1303/2598] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:27.605368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:27.606016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:27.612239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:27.612734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:27.613507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:27.613949 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:27.745104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:27.753029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-45788d56-2a2d-4c07-a6b7-7718dd140b83 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152194 May 26 21:52:27.753592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1296/2599] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:27.936453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:27.937051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:27.943488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:27.943933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:27.944716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:27.945153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:28.009411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:28.017412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f321b1ac-8b9b-42bb-8355-ed970dca30b1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084946 May 26 21:52:28.017975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1304/2600] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:28.770688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:28.771338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:28.778705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:28.779194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:28.779964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:28.780403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:28.910290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:28.919116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5db1995b-e140-41dc-82ba-1222584d5f3e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152290 May 26 21:52:28.919687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1297/2601] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:29.034503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:29.035148 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:29.042431 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:29.045116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:29.045116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:29.045116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:29.048095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:29.107937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:29.116041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b6ffd552-ec4e-4268-b1fd-273cc6476e10 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085402 May 26 21:52:29.116537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1305/2602] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:29.936924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:29.937550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:29.944027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:29.944484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:29.945286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:29.945757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:30.076455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:30.084350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-870da854-2238-470a-853b-3e537a8202d7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151389 May 26 21:52:30.084956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1298/2603] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:30.133343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:30.133958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:30.136269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:30.141105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:30.141563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:30.142329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:30.142771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:30.203783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:30.212276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b173bf35-d9c2-4e85-a795-4b24465020a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082809 May 26 21:52:30.212885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1306/2604] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:31.101961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:31.102663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:31.109130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:31.109582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:31.110334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:31.110780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:31.229128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:31.229874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:31.236385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:31.236931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:31.237698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:31.238132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:31.242074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:31.251104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ad34bcee-c70b-4d8f-87b2-17340c84c212 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152990 May 26 21:52:31.251675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1299/2605] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:31.304244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:31.312792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-18729faa-2950-47a4-8d79-f0ac9d33a9a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087549 May 26 21:52:31.313363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1307/2606] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:32.273207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:32.274450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:32.281286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:32.281748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:32.282552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:32.282996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:32.329645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:32.330375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:32.338367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:32.338807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:32.339603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:32.340035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:32.416949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:32.429194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-21e08563-3df6-4d5a-a56f-bead0e1bc6aa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.102924 May 26 21:52:32.430224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1308/2607] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:32.450053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:32.458374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e9ebe855-c5e9-4c6e-9af1-9763e4f04c08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.189047 May 26 21:52:32.458952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1300/2608] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:33.446928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:33.447492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:33.454105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:33.454560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:33.455324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:33.455764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:33.475224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:33.475841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:33.483216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:33.483663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:33.484426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:33.484896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:33.517667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:33.526412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2cb9b5fb-cd52-4b9d-b5e3-4f2624ec042b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083455 May 26 21:52:33.527327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1309/2609] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:33.617416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:33.625551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8da83a3e-74a6-474a-83d1-91dff2da4842 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154259 May 26 21:52:33.626121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1301/2610] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:34.543981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:34.544801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:34.551685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:34.552135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:34.552932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:34.553377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:34.618411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:34.626449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-99510c86-0ef4-4d78-b3ea-1b420cefa939 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086337 May 26 21:52:34.627027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1310/2611] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:34.643832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:34.644455 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:34.651031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:34.651486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:34.652280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:34.652911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:34.783247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:34.791805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-69e2ba6b-987f-4102-aee4-e7ca1f78fb60 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151948 May 26 21:52:34.792361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1302/2612] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:35.643312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:35.643929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:35.650968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:35.651421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:35.652181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:35.652649 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:35.717395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:35.725384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d71b4f63-e84a-435a-8dcb-5059f7143db8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085976 May 26 21:52:35.725957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1311/2613] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:35.808976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:35.809595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:35.816102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:35.816498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:35.817328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:35.817774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:35.946513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:35.954448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4ea4cf63-ed1e-4622-8cd6-25a8b535b0b8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149352 May 26 21:52:35.955308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1303/2614] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:36.743881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:36.744534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:36.751089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:36.751545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:36.752610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:36.753064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:36.813134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:36.821205 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-86c80ad1-ca8b-44f0-90e4-b984e101fd82 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082251 May 26 21:52:36.821778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1312/2615] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:36.973103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:36.973717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:36.980930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:36.981408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:36.982163 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:36.982670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:37.114952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:37.123671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-83e0af73-d088-4c61-b8fa-3e3eabfcf37a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154326 May 26 21:52:37.124247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1304/2616] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:37.838692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:37.839263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:37.845816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:37.846268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:37.847031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:37.847467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:37.908229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:37.916837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-958697ca-ad10-43c8-b48d-70e5b9821239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082570 May 26 21:52:37.917413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1313/2617] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:38.141500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:38.142065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:38.148525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:38.149009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:38.150357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:38.150808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:38.278022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:38.285979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-902e579a-b31a-4106-991b-7af66d4f0094 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148504 May 26 21:52:38.286553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1305/2618] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:38.933545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:38.934228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:38.940741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:38.941194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:38.941957 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:38.942397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:39.007334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:39.015548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-602a4ad5-bb2f-4d34-b3d5-5cba9f99b134 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086551 May 26 21:52:39.016119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1314/2619] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:39.302473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:39.303094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:39.305411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=56 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:39.310747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:39.311203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:39.311966 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:39.312407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:39.443767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:39.452682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8cbe40c3-64b1-4588-91a7-d2ebe8b8c942 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154057 May 26 21:52:39.453264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1306/2620] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:40.032921 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:40.033522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:40.039976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:40.040422 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:40.041219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:40.042302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:40.102680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:40.111414 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3cdd2f4d-864f-45df-aa74-5269fa25c25c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082386 May 26 21:52:40.111996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1315/2621] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:40.469851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:40.470428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:40.476882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:40.477335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:40.478091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:40.478531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:40.481569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:40.613706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:40.622676 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-29e80a9c-81d9-40e0-b0fe-1a5f7c6de501 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156794 May 26 21:52:40.623248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1307/2622] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:41.128914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:41.129484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:41.136680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:41.137131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:41.137896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:41.138355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:41.204209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:41.212154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f48cf564-2281-458b-8518-9e680bc69966 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087351 May 26 21:52:41.218757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1316/2623] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:41.640193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:41.640835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:41.647632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:41.648086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:41.648961 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:41.649405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:41.778993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:41.787027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-590fe0b7-7d4d-4dfb-9f8e-769a0a17f7e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150715 May 26 21:52:41.787590 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1308/2624] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:42.229769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:42.230385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:42.237145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:42.237599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:42.238357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:42.238876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:42.305849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:42.314654 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b0a59dad-2993-4909-8107-f99c8d017aae tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088780 May 26 21:52:42.315226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1317/2625] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:42.805087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:42.805702 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:42.812948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:42.813340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:42.814103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:42.814545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:42.943483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:42.951402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-27620c6a-54d0-4210-85c4-911e928f359c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150249 May 26 21:52:42.951976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1309/2626] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:43.338459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:43.339067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:43.346338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:43.346786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:43.347542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:43.347976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:43.409940 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:43.417894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cf022fbb-4e03-40b1-89f8-f39ac690d135 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083277 May 26 21:52:43.418447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1318/2627] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:43.968811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:43.969382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:43.975941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:43.976398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:43.977196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:43.977646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:44.108326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:44.116540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-84a910bf-b8b8-4dee-a5d0-eda3d791c3a8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151740 May 26 21:52:44.117171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1310/2628] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:44.434873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:44.435483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:44.443192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:44.443994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:44.445374 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:44.446165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:44.517741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:44.525699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d30f0944-0644-4278-aac3-55f7f8b834ec tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.094790 May 26 21:52:44.526272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1319/2629] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:45.134892 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:45.135510 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:45.142755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:45.143216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:45.143978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:45.144422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:45.271773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:45.280020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-67bff596-2acc-42ab-b5ac-c6c75410cad0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149040 May 26 21:52:45.280628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1311/2630] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:45.542999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:45.544153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:45.550637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:45.551089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:45.551881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:45.552309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:45.617976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:45.626908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-861d2017-f4c9-41d8-978e-2c531592b239 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087764 May 26 21:52:45.627467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1320/2631] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:46.297257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:46.297868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:46.304360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:46.304840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:46.305586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:46.306018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:46.432893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:46.440806 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-167daeba-7a5b-446e-80f1-c05def7c1784 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147322 May 26 21:52:46.441378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1312/2632] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:46.645078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:46.645698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:46.652212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:46.652694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:46.653460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:46.653902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:46.715626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:46.719025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:46.723758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96584324-5537-458c-8f6b-3a36905f2cd7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083581 May 26 21:52:46.724322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1321/2633] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:47.458539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:47.459187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:47.466212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:47.466664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:47.467419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:47.467855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:47.598917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:47.607632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ad505d49-e23a-477c-b21f-72f1f0b2fab6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152942 May 26 21:52:47.608231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1313/2634] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:47.747979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:47.748622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:47.755457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:47.755912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:47.756709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:47.757153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:47.818143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:47.826715 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-142df5b5-d969-469e-9ff2-89ba663394d3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082640 May 26 21:52:47.827291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1322/2635] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:48.626021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:48.626644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:48.633596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:48.634053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:48.634825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:48.635267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:48.765268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:48.773333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c32a19e-3c6a-4679-a64d-4676eb197cc7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151917 May 26 21:52:48.774200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1314/2636] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:48.843236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:48.844166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:48.850194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:48.850647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:48.851407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:48.851849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:48.917938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:48.926916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d80ddda2-bc22-4c50-b2dc-edda4b238a2d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088197 May 26 21:52:48.927559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1323/2637] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:49.790376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:49.790975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:49.797563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:49.798017 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:49.798770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:49.799211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:49.928710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:49.937278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-97eac9dc-abd6-451f-a19c-726e09b45b4c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150816 May 26 21:52:49.937846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1315/2638] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:49.943020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:49.943636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:49.950083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:49.950535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:49.951939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:49.952378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:50.013481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:50.021340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d96471a2-3326-4bba-b278-03fe063feb51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082044 May 26 21:52:50.022028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1324/2639] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:50.955184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:50.955748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:50.962248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:50.962698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:50.963486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:50.963931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:51.045545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:51.046187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:51.052939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:51.053398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:51.054168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:51.054610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:51.106614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:51.115042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0e827e96-086e-4475-849b-8fd9b2d1daac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.164304 May 26 21:52:51.115628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1316/2640] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:51.123704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:51.131683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ded598d9-4493-40b3-8c20-c242054775f3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090557 May 26 21:52:51.132262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1325/2641] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:52.133651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:52.134264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:52.140890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:52.141344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:52.142103 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:52.142550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:52.150834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:52.151462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:52.158651 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:52.159107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:52.159877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:52.160317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:52.237917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:52.246275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-31548069-6bf1-40eb-b784-ecbca8e4c883 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.099203 May 26 21:52:52.246843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1326/2642] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:52.296504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:52.304453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c2753ea-ac6f-423a-8715-d05b8045974e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.174801 May 26 21:52:52.305062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1317/2643] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:53.262475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:53.263098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:53.270096 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:53.270541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:53.271302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:53.271736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:53.321732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:53.322451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:53.329662 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:53.330106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:53.330879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:53.331331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:53.335423 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:53.343690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-045fdc93-5afb-459a-88ef-36fcc7988ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084994 May 26 21:52:53.344275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1327/2644] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:53.460061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:53.468039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c2afeb6-7bc5-4c27-a45a-9985162cf291 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150249 May 26 21:52:53.468630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1318/2645] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:52:54.361572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:54.362183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:54.368952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:54.369406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:54.370169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:54.370611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:54.431126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:54.439040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e45ff810-3bc9-4d4e-86ea-d36209a323f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082152 May 26 21:52:54.439598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1328/2646] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:54.484861 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:54.485488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:54.494717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:54.495180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:54.496262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:54.496743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:54.628519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:54.653947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-480675ea-df05-4298-901c-d9442e2afe9d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155503 May 26 21:52:54.653947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1319/2647] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:55.455988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:55.456540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:55.463072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:55.463525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:55.464288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:55.464758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:55.528087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:55.536039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cb31a2cd-73c5-46e5-9ac8-d5f266d59830 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083996 May 26 21:52:55.536628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1329/2648] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:55.669587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:55.670872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:55.677460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:55.677911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:55.678678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:55.679119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:55.806638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:55.814899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-98b3774b-313b-47e3-ba15-2cac0b8ee173 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149235 May 26 21:52:55.815475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1320/2649] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:56.553936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:56.554542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:56.561695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:56.562135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:56.562889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:56.563321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:56.627565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:56.635518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-086953c1-e3c9-4196-bc0b-48ef0507f41f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085507 May 26 21:52:56.636075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1330/2650] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:56.832462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:56.833069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:56.839446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:56.839894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:56.840685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:56.841119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:56.967303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:56.975169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-33eea255-14ac-4c8b-b3b1-1a18adfd3d55 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146640 May 26 21:52:56.975745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1321/2651] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:57.654199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:57.654855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:57.662799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:57.663244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:57.664056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:57.664491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:57.726384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:57.738013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ab2c7a36-e8ad-4c46-978e-18758e2a438c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086927 May 26 21:52:57.738582 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1331/2652] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:57.993077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:57.993700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:57.999903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:58.000353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:58.001148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:58.002093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:58.140283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:58.148437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78b094d1-219d-486c-aba1-4a8f4184fb6b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.159467 May 26 21:52:58.149034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1322/2653] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:58.755218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:58.755831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:58.762458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:58.762913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:58.763675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:58.764117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:58.824910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:58.832845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-300da04f-75de-48e2-b64b-da225f8c1283 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081481 May 26 21:52:58.833409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1332/2654] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:58.855064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:52:58.855259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:52:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:52:59.165850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:59.166408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:59.172851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:59.173306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:59.174070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:59.174507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:59.469133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:59.471336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:52:59.477606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9bc3eb6f-05d9-4e9c-9db0-0348cc1be112 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.315766 May 26 21:52:59.478170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1323/2655] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:52:59.849866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:52:59.850492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:52:59.857021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:59.857473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:59.858236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:52:59.858678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:52:59.922815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:52:59.931458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-164573af-c1a2-4033-8b11-3e405424aef8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085468 May 26 21:52:59.932038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1333/2656] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:52:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:00.495204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:00.495825 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:00.502793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:00.503245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:00.504009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:00.504449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:00.631854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:00.640613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-12c1fa0d-8681-4044-a89d-a24ff16f22e1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149431 May 26 21:53:00.641187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1324/2657] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:00.949071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:00.949823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:00.951892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:00.957376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:00.957833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:00.958606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:00.959042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:01.021033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:01.028964 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-806a185e-c579-452e-9945-a799fadfad21 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083917 May 26 21:53:01.029531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1334/2658] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:01.658781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:01.659442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:01.666037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:01.666494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:01.667266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:01.667704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:01.798820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:01.806857 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dc1edd31-f047-422e-85f7-53df452d741b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151994 May 26 21:53:01.807424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1325/2659] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:02.046446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:02.047056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:02.054119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:02.054573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:02.055413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:02.055784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:02.118504 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:02.126628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-db3d0d75-1320-47e7-ad05-cfbae7536f11 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084173 May 26 21:53:02.127200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1335/2660] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:02.824870 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:02.825451 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:02.832382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:02.832864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:02.833631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:02.834074 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:02.961613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:02.969506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-353ec2e6-c671-4f02-8921-2ed037b38848 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148618 May 26 21:53:02.970070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1326/2661] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:03.144727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:03.145335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:03.151868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:03.152323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:03.153121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:03.153560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:03.219329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:03.227302 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b0f0aea7-cd85-4f1d-a1b8-b42a975a9975 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087143 May 26 21:53:03.229614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1336/2662] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:03.987140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:03.987706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:03.995028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:03.995486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:03.996253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:03.996731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:04.122962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:04.131169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-af1a48e5-30b4-4be2-9a7e-321290da5a35 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148037 May 26 21:53:04.131729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1327/2663] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:04.244299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:04.244895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:04.251348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:04.251790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:04.252533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:04.252983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:04.313650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:04.321650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d9887c21-3837-4afe-b56e-924a63484ce1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081495 May 26 21:53:04.322216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1337/2664] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:05.148620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:05.149231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:05.155801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:05.156258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:05.157046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:05.157488 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:05.289796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:05.297822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-45ec4353-dcdf-4cd0-b475-b68154700235 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153126 May 26 21:53:05.300272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1328/2665] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:05.338283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:05.338966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:05.345531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:05.345983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:05.346743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:05.347185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:05.365880 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:05.408286 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:05.416554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a2f42d4c-02c2-4368-aa40-763daa291009 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082173 May 26 21:53:05.417134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1338/2666] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:06.315761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:06.316376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:06.323384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:06.323843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:06.324614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:06.325057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:06.434056 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:06.434704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:06.441105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:06.441557 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:06.442831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:06.443269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:06.453588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:06.462192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-980eeebc-b69a-40ad-88c7-c1388cd6991e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150308 May 26 21:53:06.462763 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1329/2667] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:06.508105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:06.516396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-32d5f06e-9bac-422b-b039-a6b70e75ec8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086156 May 26 21:53:06.517005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1339/2668] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:07.587619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:07.588263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:07.594285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:07.594729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:07.595492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:07.595924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:07.678689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:07.679316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:07.685546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:07.686109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:07.686901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:07.687332 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:07.736971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:07.745921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2b397637-3232-4f81-a23d-05daaa69c864 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.270508 May 26 21:53:07.746500 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1330/2669] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:07.753697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:07.762546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-175a58f9-6506-485b-bfaf-ac49a48a8c18 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.232637 May 26 21:53:07.763115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1340/2670] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:08.763164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:08.763812 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:08.770347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:08.770798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:08.771569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:08.771994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:08.778865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:08.779489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:08.786387 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:08.786844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:08.787611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:08.788568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:08.871006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:08.878949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-16f5d206-9080-47c9-a0cb-9ec87af23726 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.103877 May 26 21:53:08.879520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1341/2671] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:08.929591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:08.937620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-22afd011-355a-46fd-a48d-0352e8b3251c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.178261 May 26 21:53:08.938194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1331/2672] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:09.895762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:09.896321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:09.903350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:09.903795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:09.904545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:09.905002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:09.954764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:09.955368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:09.957698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:09.963154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:09.963670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:09.964450 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:09.964925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:09.969448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:09.975519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1f3346c5-564b-4a49-a45c-5f7718146146 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083755 May 26 21:53:09.976156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1342/2673] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:10.094241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:10.102088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c4c9ad3-28c9-4118-972f-94a5f8d484b9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151202 May 26 21:53:10.102648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1332/2674] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:10.992757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:10.993457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:10.999932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:11.000364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:11.001155 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:11.001595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:11.064137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:11.072080 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1eabbb3f-b15d-42d1-9e87-f5d1589f2837 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083588 May 26 21:53:11.072660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1343/2675] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:11.119271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:11.119898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:11.126528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:11.126985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:11.127759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:11.128204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:11.256992 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:11.265406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eaaebaa8-e18c-410b-a685-676d06b407b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150347 May 26 21:53:11.265974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1333/2676] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:12.088955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:12.089577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:12.095922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:12.096388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:12.097195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:12.097627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:12.158267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:12.166136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eb269037-d933-4dcd-bbfe-b73da1b2b130 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081073 May 26 21:53:12.166701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1344/2677] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:12.284947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:12.284947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:12.291438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:12.295659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:12.295659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:12.295659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:12.427047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:12.435042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a3e7370d-95d4-4e37-8586-c6baddb31cd9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154789 May 26 21:53:12.438844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1334/2678] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:12.486833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:53:12.487141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:53:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:53:13.183404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:13.184107 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:13.190644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:13.191092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:13.191849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:13.192315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:13.252512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:13.260384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-044b04dd-1850-484f-be12-d74aaa29276e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080842 May 26 21:53:13.260982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1345/2679] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:13.453219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:13.453775 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:13.460274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:13.460777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:13.461537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:13.461980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:13.592193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:13.600906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9a3346b8-3814-47ee-aa0a-b4c177679fe0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152206 May 26 21:53:13.601475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1335/2680] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:14.277625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:14.278262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:14.284856 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:14.285305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:14.286052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:14.286482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:14.349725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:14.357576 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ef28cf35-5f1b-4745-9b40-08ea67d790a6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083801 May 26 21:53:14.358787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1346/2681] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:14.618799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:14.619401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:14.625974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:14.626434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:14.627202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:14.627643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:14.755185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:14.763126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c290d510-ac72-46e3-a36f-f1f44f23144b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148434 May 26 21:53:14.763738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1336/2682] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:15.375071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:15.375729 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:15.382330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:15.382780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:15.383545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:15.383985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:15.444844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:15.453328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9fcf6721-81d2-4d44-95eb-58f459fc6ac8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081755 May 26 21:53:15.453894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1347/2683] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:15.780910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:15.782158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:15.788695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:15.789143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:15.789899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:15.790335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:15.918711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:15.927155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dd3469dc-46d1-4f8f-9936-72fda91d9600 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150146 May 26 21:53:15.927720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1337/2684] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:16.470865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:16.471479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:16.477969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:16.478419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:16.479174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:16.479609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:16.540982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:16.549305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b457c3f0-3eeb-4f2b-9d44-b1995e0696df tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082898 May 26 21:53:16.549883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1348/2685] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:16.943964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:16.944596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:16.951066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:16.951519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:16.952276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:16.953288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:17.079261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:17.087127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eeb7fc77-0425-4146-b743-a27c1b23f07f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147036 May 26 21:53:17.087695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1338/2686] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:17.566163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:17.566807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:17.573595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:17.574045 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:17.574903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:17.575397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:17.643388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:17.651844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9c76b663-a9ac-40a1-b47c-699c796ac459 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089570 May 26 21:53:17.652416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1349/2687] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:18.105230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:18.105838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:18.112564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:18.113209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:18.114284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:18.114866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:18.244718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:18.253361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c5722d05-c0f8-4818-b3e2-a8a48655bc74 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152204 May 26 21:53:18.253927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1339/2688] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:18.669386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:18.670003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:18.676722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:18.677399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:18.678336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:18.678942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:18.740133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:18.748539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2421433c-9a05-46b4-8d63-8109e9458992 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083158 May 26 21:53:18.749131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1350/2689] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:19.271693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:19.272304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:19.282635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:19.283095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:19.283869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:19.284311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:19.299050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:19.417065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:19.425034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-51c497aa-5c15-43f4-bbac-c8df721f6f29 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.157418 May 26 21:53:19.425603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1340/2690] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:19.766520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:19.767119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:19.773757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:19.774214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:19.774979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:19.775415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:19.845100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:19.853218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c9cb724e-772e-4a54-8881-9858eaa8ddb0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090668 May 26 21:53:19.853780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1351/2691] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:20.442888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:20.443498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:20.449987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:20.450437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:20.451191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:20.451625 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:20.581550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:20.589477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2eb4d0b7-0313-4247-885c-6031f063bdca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150446 May 26 21:53:20.590047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1341/2692] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:20.871739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:20.872379 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:20.879813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:20.880269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:20.881069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:20.881519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:20.946521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:20.954830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1022e1bc-5b0f-4bd6-9a0a-0b3fb91cdd79 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087016 May 26 21:53:20.955509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1352/2693] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:21.607209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:21.607833 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:21.614469 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:21.614917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:21.615673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:21.616369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:21.744550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:21.752481 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-21e33ae2-82ad-498d-9ca1-e71d8b224575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149148 May 26 21:53:21.753084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1342/2694] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:21.972002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:21.972608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:21.979040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:21.979491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:21.980253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:21.980735 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:22.041101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:22.049037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0e3f40ca-26fc-4879-a81f-0cc560c7aa6f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080988 May 26 21:53:22.049607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1353/2695] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:22.769502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:22.770121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:22.776620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:22.777081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:22.777843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:22.778286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:22.906852 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:22.914821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3655a7a-6644-4696-912e-a810f039baeb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149220 May 26 21:53:22.915398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1343/2696] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:23.065670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:23.066297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:23.072826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:23.073280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:23.074044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:23.074491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:23.134562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:23.143081 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c8b4b50f-6d04-4fd9-abf8-e629601a8d1c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081248 May 26 21:53:23.143652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1354/2697] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:23.932522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:23.933206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:23.940332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:23.940826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:23.941597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:23.942046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:24.068141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:24.076136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-290ab371-d5df-4d9b-8198-566e0f0bab91 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147512 May 26 21:53:24.076724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1344/2698] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:24.160313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:24.160965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:24.167517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:24.167970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:24.168766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:24.169214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:24.173206 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:24.232078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:24.240828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-85e69250-4246-4d2c-a588-219bd572e65b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084862 May 26 21:53:24.241660 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1355/2699] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:25.093468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:25.094083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:25.100616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:25.101075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:25.101845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:25.102308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:25.229773 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:25.237851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea01339b-8bd6-4eb2-a4f6-2dbf31ab4c0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148325 May 26 21:53:25.238971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1345/2700] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:25.258478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:25.261745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:25.265652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:25.266106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:25.266890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:25.267313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:25.329352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:25.337393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-af0ec62e-7b9e-4f69-b280-448106a6c5e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083238 May 26 21:53:25.337966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1356/2701] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:26.256728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:26.257383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:26.264157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:26.264647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:26.265464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:26.265910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:26.354567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:26.355223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:26.362227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:26.362938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:26.363507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:26.364024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:26.663047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:26.671261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1c584101-e54c-4ea0-865f-df615d7860ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.419104 May 26 21:53:26.672136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1346/2702] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:26.679519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:26.687620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-06c02704-2367-465e-83e1-6f2fda2f5932 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.337018 May 26 21:53:26.688188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1357/2703] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:27.689046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:27.689467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:27.696428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:27.696920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:27.697690 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:27.698138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:27.704394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:27.705062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:27.711509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:27.712034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:27.712837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:27.713276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:27.791934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:27.799997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cf596283-fdf6-46c2-bd42-51e789e0c083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.099432 May 26 21:53:27.800573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1358/2704] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:27.852482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:27.860534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-89438d28-8bb8-4823-874b-747e079c779d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.175876 May 26 21:53:27.861126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1347/2705] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:28.818308 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:28.818860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:28.825439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:28.825911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:28.826670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:28.827103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:28.878633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:28.879235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:28.886715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:28.887559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:28.887976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:28.888415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:28.889684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:28.897814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1da8ff9e-e9c7-4af6-9275-34d8d3756225 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084023 May 26 21:53:28.898385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1359/2706] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:29.024136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:29.032641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4de7742e-e4ee-4949-aca1-2e4782d7b8cb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.157838 May 26 21:53:29.033220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1348/2707] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:29.915517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:29.916061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:29.922746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:29.923202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:29.923972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:29.924471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:29.986027 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:29.994908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dcadbd92-9685-431c-8c28-5bed80d131ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083534 May 26 21:53:29.995487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1360/2708] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:30.050340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:30.050958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:30.058006 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:30.058493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:30.059261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:30.059704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:30.189325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:30.197294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-778af49f-f5d3-40be-8e56-6e847a7a4819 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150815 May 26 21:53:30.197872 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1349/2709] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:31.012342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:31.013657 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:31.015378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=54 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:31.020240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:31.020773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:31.021589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:31.022071 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:31.085347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:31.093795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4fc9bebd-1593-4282-ba36-b13c0d3a3cdc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085304 May 26 21:53:31.094368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1361/2710] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:31.214640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:31.215326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:31.221906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:31.222365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:31.223136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:31.223579 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:31.352712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:31.360683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fd1c4312-3e0d-468f-bf96-12813fb579f0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149938 May 26 21:53:31.363059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1350/2711] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:32.111269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:32.111989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:32.119036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:32.119481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:32.120237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:32.120702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:32.189297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:32.197772 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d4e19a1c-d6e7-457e-813f-f4ee66d9c887 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090672 May 26 21:53:32.198337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1362/2712] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:32.378454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:32.379054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:32.386164 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:32.386621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:32.387390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:32.387837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:32.515824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:32.524722 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-50507931-43dd-4a9f-b722-bfd64d4665ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150342 May 26 21:53:32.525298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1351/2713] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:33.214448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:33.215067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:33.221664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:33.222116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:33.222882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:33.223323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:33.284691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:33.293238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3e15ba61-99ea-4c8d-ae5d-2d7bea9c26eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082636 May 26 21:53:33.293795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1363/2714] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:33.542796 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:33.543413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:33.549964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:33.550422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:33.551186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:33.551634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:33.683996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:33.692158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-539f965f-0481-4b14-b445-753111318cbd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153759 May 26 21:53:33.692849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1352/2715] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:34.310912 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:34.311552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:34.318187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:34.318628 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:34.319389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:34.320448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:34.383210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:34.391622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e24bc9f8-1bb6-4e3d-94f3-7f2d73cee7db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084520 May 26 21:53:34.392288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1364/2716] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:34.709079 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:34.709658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:34.716060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:34.716503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:34.717297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:34.717732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:34.846281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:34.854941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70b01506-2040-431c-9546-96f0279c999a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149784 May 26 21:53:34.855502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1353/2717] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:35.409035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:35.409679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:35.416255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:35.416734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:35.417496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:35.417934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:35.482440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:35.490432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-658ff16a-884d-4809-b3da-6d08a438f47f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085238 May 26 21:53:35.491262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1365/2718] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:35.872456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:35.873102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:35.879548 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:35.879995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:35.880791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:35.881225 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:36.011774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:36.019846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a67ee629-6d26-41a0-beb3-1c1f14e790d5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151253 May 26 21:53:36.020422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1354/2719] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:36.508226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:36.508877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:36.515371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:36.515823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:36.516573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:36.517040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:36.578682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:36.587484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-91e39bb4-fed7-4668-9295-4bee68e45620 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083216 May 26 21:53:36.588069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1366/2720] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:37.037989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:37.038608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:37.045331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:37.045788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:37.046552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:37.046997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:37.183934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:37.192273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ece53879-93c4-4051-9c96-7c88c9146287 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.158239 May 26 21:53:37.192913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1355/2721] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:37.605398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:37.606033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:37.612658 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:37.613109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:37.613892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:37.614338 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:37.676554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:37.685153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ace9e4b2-4823-414c-a8f7-b1e2ebf5f5b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084216 May 26 21:53:37.685722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1367/2722] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:38.210317 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:38.210950 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:38.217641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:38.218106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:38.218875 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:38.219316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:38.347133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:38.355789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-198cf49e-d172-44ab-b853-1591150b3e31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149417 May 26 21:53:38.356605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1356/2723] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:38.702214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:38.703197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:38.709720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:38.710730 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:38.711491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:38.711955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:38.776923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:38.784965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aab1b85d-ea97-4f9d-91fe-f207044bce7e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086570 May 26 21:53:38.785542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1368/2724] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:39.373265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:39.373996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:39.380523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:39.381015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:39.381799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:39.382242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:39.384952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:39.513418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:39.521592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9c7cdb62-4fef-4e61-a679-d8beac108aca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152209 May 26 21:53:39.522168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1357/2725] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:39.803015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:39.803669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:39.810274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:39.810726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:39.811517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:39.811963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:39.877108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:39.885529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bb2f887c-479c-4bd2-908d-24b6c41d57f1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086412 May 26 21:53:39.886101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1369/2726] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:40.539891 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:40.540492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:40.542884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:40.547748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:40.548191 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:40.549062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:40.549509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:40.687332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:40.695462 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7087627b-fb2b-4384-87b9-0cf4d5053b7a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.159887 May 26 21:53:40.696045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1358/2727] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:40.903209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:40.903905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:40.910533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:40.910978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:40.911738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:40.912201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:40.973642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:40.982196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0b48f9fc-8c1f-4e07-a670-bb0b7c0320f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082932 May 26 21:53:40.982763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1370/2728] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:41.712929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:41.713557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:41.720030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:41.720490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:41.721296 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:41.721742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:41.850527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:41.858471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ec1b997-bcb2-4f5c-8f22-5d1aedaae491 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149513 May 26 21:53:41.859040 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1359/2729] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:41.999441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:42.000067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:42.006663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:42.007111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:42.007878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:42.008317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:42.072392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:42.075775 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:42.080503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-65cd3a50-f054-42a9-82c1-fd9c0dc02e58 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084967 May 26 21:53:42.081106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1371/2730] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:42.876427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:42.877041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:42.884055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:42.884511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:42.885304 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:42.885748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:43.017558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:43.026274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7661c39d-dc16-4d78-aead-7e5a54712b2d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153826 May 26 21:53:43.026845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1360/2731] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:43.105763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:43.106369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:43.113396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:43.113664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:43.114435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:43.114872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:43.176612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:43.185046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5690af4b-be7d-4773-861c-84aa0d69c3eb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083478 May 26 21:53:43.185614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1372/2732] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:44.043367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:44.043986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:44.050747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:44.051206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:44.051981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:44.052427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:44.187688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:44.196104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-761d4f30-6b17-4c96-bf35-10dce867d364 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156537 May 26 21:53:44.196712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1361/2733] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:44.202554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:44.203198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:44.209873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:44.210430 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:44.211194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:44.211629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:44.275446 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:44.283561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3617f0c8-c5a5-4c24-901e-f2bd2845b6d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084764 May 26 21:53:44.284138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1373/2734] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:45.213492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:45.214245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:45.221089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:45.221546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:45.222433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:45.222764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:45.301421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:45.302029 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:45.309026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:45.310547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:45.310547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:45.310765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:45.385225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:45.388569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:45.393443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-59866997-5207-4eed-ae30-275ce9fce6b9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.095803 May 26 21:53:45.394017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1374/2735] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:45.397012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c63aa3bb-8fba-42a3-8108-19a57e14e725 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.188047 May 26 21:53:45.397599 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1362/2736] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:46.410696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:46.411372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:46.414739 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:46.415403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:46.419044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:46.419499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:46.420278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:46.420753 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:46.421889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:46.422348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:46.423123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:46.423570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:46.492802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:46.501043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2cc64410-a427-44d6-a829-b0a8f87e1e72 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.094265 May 26 21:53:46.501852 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1375/2737] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:46.579485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:46.588100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-974024f4-4241-4888-bc9d-f750d424f075 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.177828 May 26 21:53:46.588688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1363/2738] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:47.518134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:47.518742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:47.525916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:47.526360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:47.527109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:47.527538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:47.590275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:47.598383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-df48f05b-9091-4b89-a6fb-9e67b8b75aa4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084113 May 26 21:53:47.598948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1376/2739] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:47.605946 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:47.606781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:47.613595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:47.614053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:47.614821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:47.615264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:47.748184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:47.756337 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5fb61ae2-ff50-489e-b1ae-0c419b00e6c9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154257 May 26 21:53:47.756935 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1364/2740] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:48.614941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:48.615942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:48.623217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:48.623731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:48.624878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:48.625624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:48.691636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:48.700220 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de2b408c-a911-4c0c-8831-4a7d51b8e4e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089148 May 26 21:53:48.700845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1377/2741] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:48.774760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:48.775403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:48.781972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:48.782434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:48.783201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:48.783647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:48.911119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:48.919821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e1b09965-9867-4aa9-ab2b-ef4443414591 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149425 May 26 21:53:48.920387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1365/2742] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:49.716373 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:49.717008 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:49.723475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:49.723911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:49.724683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:49.725116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:49.789555 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:49.797608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4eba3558-2963-4b20-b464-8b479741efdb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085211 May 26 21:53:49.798169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1378/2743] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:49.937222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:49.937792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:49.944215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:49.944705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:49.945465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:49.945905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:50.073868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:50.081766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4257c2c3-0fbf-4bd7-bd8e-ed3a94dcfefe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148495 May 26 21:53:50.082340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1366/2744] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:50.815117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:50.815666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:50.822738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:50.823196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:50.823956 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:50.824396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:50.887078 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:50.895040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8584cadb-011f-4e33-8edc-8024859511f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083852 May 26 21:53:50.895612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1379/2745] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:51.099295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:51.099883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:51.106582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:51.107028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:51.107782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:51.108268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:51.248899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:51.257271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3f8f283e-8226-41d1-9359-66a8592c3fc2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.161968 May 26 21:53:51.261732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1367/2746] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:51.911897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:51.912448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:51.919656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:51.920106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:51.920902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:51.921342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:51.982222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:51.990389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-72935dfc-1b96-45a8-8aac-32b5ddb271a3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082199 May 26 21:53:51.990971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1380/2747] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:52.276821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:52.277445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:52.284140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:52.284613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:52.285396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:52.285844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:52.417667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:52.425687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-dfbd6012-5d7d-4164-8202-9b2a810d1d43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153525 May 26 21:53:52.426281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1368/2748] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:53.007255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:53.007884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:53.014463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:53.014916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:53.015684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:53.016128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:53.081090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:53.089150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6c30889e-e792-4212-a234-e78ce5ca65ed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085746 May 26 21:53:53.089720 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1381/2749] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:53.444051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:53.444765 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:53.451366 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:53.451824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:53.452605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:53.453063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:53.583802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:53.592448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d50b425f-c081-46a9-8e45-b9f130908de5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152419 May 26 21:53:53.593060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1369/2750] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:54.105266 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:54.105922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:54.112473 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:54.112951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:54.113710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:54.114142 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:54.178089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:54.186577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8b4b7d9a-f905-456f-abc5-4d67ab23c99b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085292 May 26 21:53:54.187161 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1382/2751] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:54.610020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:54.610685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:54.618261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:54.618719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:54.619496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:54.619938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:54.753896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:54.761859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e20ad4bb-e26d-47ad-b0c1-1c032e5c585a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155842 May 26 21:53:54.762427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1370/2752] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:55.204292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:55.204937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:55.212140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:55.212606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:55.213383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:55.213822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:55.432502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:55.440714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f55d3949-df72-4867-ad76-5dc12dfcf78d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.240271 May 26 21:53:55.441278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1383/2753] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:55.778185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:55.778876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:55.785332 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:55.785788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:55.786555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:55.786993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:55.912843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:55.921283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3ddc35b5-7017-4cae-abd4-9bbbb9565794 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146951 May 26 21:53:55.921856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1371/2754] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:56.458232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:56.458848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:56.465954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:56.466405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:56.467167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:56.467605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:56.531673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:56.539532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d81a4347-886a-4735-9135-8f9e6e8b5e3b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085168 May 26 21:53:56.540091 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1384/2755] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:56.938835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:56.939456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:56.946653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:56.947109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:56.947883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:56.948334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:57.082513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:57.090609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-030f0a6c-b2fb-4bd2-9328-6d65f0830632 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155813 May 26 21:53:57.091258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1372/2756] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:57.556941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:57.557603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:57.564103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:57.564560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:57.565355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:57.565800 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:57.628515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:57.636780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d37ac797-a241-4469-bff8-2434bdca0a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084223 May 26 21:53:57.637357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1385/2757] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:58.108118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:58.108767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:58.115269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:58.115731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:58.116511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:58.116994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:58.249298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:58.251466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:53:58.258015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ca552fdb-35c7-46a4-9670-136ba70e438c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153989 May 26 21:53:58.258580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1373/2758] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:58.654839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:58.655693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:58.662077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:58.662525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:58.663288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:58.663752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:58.729348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:58.737513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0691e89f-2e5d-4402-9bd1-b5cac2581824 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086545 May 26 21:53:58.738073 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1386/2759] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:53:59.287943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:59.288547 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:59.295167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:59.295621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:59.296394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:59.296873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:59.429504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:59.438421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2bc5ac25-d653-4740-bb17-ce189ea79c8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154623 May 26 21:53:59.439005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1374/2760] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:53:59.754608 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:53:59.755236 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:53:59.761717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:59.762165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:59.762913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:53:59.763346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:53:59.828728 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:53:59.836538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17637659-7d80-4681-8af2-f98f82110f01 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085775 May 26 21:53:59.837116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1387/2761] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:53:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:00.456844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:00.457493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:00.465051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:00.465505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:00.466286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:00.466730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:00.599083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:00.607471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c9907bfd-1010-4e22-81b0-dfd7f806cdb2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154209 May 26 21:54:00.608053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1375/2762] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:00.853542 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:00.854151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:00.860687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:00.861133 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:00.861884 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:00.862317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:00.880537 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:00.923841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:00.932211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-34c6f78c-0fc5-4dfc-9578-d7ad0140554c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082667 May 26 21:54:00.932807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1388/2763] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:01.625738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:01.626363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:01.633616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:01.634070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:01.634839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:01.635283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:01.766696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:01.774618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f4e2aa49-4d24-479a-a606-9603b2c32b84 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152972 May 26 21:54:01.775185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1376/2764] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:01.949195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:01.949745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:01.956415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:01.957024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:01.957791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:01.958224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:02.021455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:02.029526 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-835f0ba9-c272-4df4-8ef2-48c5766b6a64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084314 May 26 21:54:02.030086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1389/2765] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:02.791528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:02.792222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:02.799121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:02.799575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:02.800345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:02.800853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:02.927706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:02.936670 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-50aef11d-ab1e-42b6-8592-f382fd2c73ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149098 May 26 21:54:02.937248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1377/2766] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:03.045928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:03.046544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:03.048892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:03.053767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:03.054218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:03.055486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:03.055922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:03.121879 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:03.133416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-490a9bea-448f-4209-976d-b89d00c5a9e0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087870 May 26 21:54:03.133416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1390/2767] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:03.954623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:03.955194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:03.962093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:03.962550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:03.963322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:03.964313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:04.091737 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:04.099686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cbb5b0f6-115d-41ec-8a0f-3174db9c684f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149020 May 26 21:54:04.100256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1378/2768] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:04.147183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:04.147812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:04.154816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:04.155263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:04.156039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:04.156468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:04.216351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:04.224203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cb2ce882-6b05-4476-b054-7145aba4402a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080838 May 26 21:54:04.224797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1391/2769] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:05.118656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:05.119275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:05.126362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:05.126827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:05.127596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:05.128039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:05.241860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:05.242496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:05.249616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:05.257632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:05.257632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:05.257632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:05.260471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:05.268395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d9f8afb0-d240-4c2c-bb7f-ff2db3803807 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153940 May 26 21:54:05.269086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1379/2770] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:05.313476 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:05.321517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-270e2eee-f246-48cb-b188-4da9739c4bf2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083809 May 26 21:54:05.322085 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1392/2771] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:06.285725 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:06.286347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:06.292917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:06.293367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:06.294138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:06.294586 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:06.338196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:06.338801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:06.345394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:06.345851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:06.346613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:06.347051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:06.418546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:06.426943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-989b424f-a874-4e37-b783-46df008191fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.092509 May 26 21:54:06.427672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1393/2772] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:06.447787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:06.456367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e65c65d4-71d3-4aca-8dd9-3050029bea4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.174602 May 26 21:54:06.456967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1380/2773] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:07.444849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:07.445413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:07.452447 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:07.452934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:07.453704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:07.454499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:07.473598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:07.474220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:07.480724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:07.481185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:07.481953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:07.482395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:07.521845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:07.530716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0e90f9cf-f641-4fe1-ad88-f7ff9328b86a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.090026 May 26 21:54:07.531319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1394/2774] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:07.616400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:07.624284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9457a5e6-5ae5-4172-aeb4-87f4858f2da2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154504 May 26 21:54:07.624871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1381/2775] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:08.548213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:08.548886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:08.555438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:08.555897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:08.556695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:08.557141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:08.620944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:08.628915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5c086809-db4b-4fb8-bde3-93a3b8068492 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085484 May 26 21:54:08.629478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1395/2776] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:08.641209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:08.641839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:08.648813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:08.649272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:08.650041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:08.650486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:08.785728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:08.793744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-de3abdb2-acb6-4746-8eff-ce3fbf26d73e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156434 May 26 21:54:08.794323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1382/2777] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:09.646211 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:09.646868 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:09.653443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:09.653896 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:09.654677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:09.655111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:09.716311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:09.724496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-426e92e6-7a57-4324-93ff-b06f15b1c7ac tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082144 May 26 21:54:09.725092 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1396/2778] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:09.811941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:09.812534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:09.819012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:09.819470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:09.820243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:09.820716 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:09.946976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:09.954912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f85b4d31-e367-4083-af6a-173a91151903 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147617 May 26 21:54:09.955479 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1383/2779] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:10.742241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:10.742835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:10.749989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:10.750437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:10.751192 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:10.751625 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:10.816337 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:10.824335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5ad27875-b68f-4d97-bae9-6f6db214e8b2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086307 May 26 21:54:10.824926 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1397/2780] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:10.972157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:10.972838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:10.975117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:10.979826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:10.980284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:10.981084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:10.981528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:11.107925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:11.116770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-beca0cd8-90fa-486e-a087-9de9f17da673 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148498 May 26 21:54:11.117340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1384/2781] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:11.842014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:11.842545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:11.849903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:11.850362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:11.851123 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:11.851562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:11.913700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:11.921681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e040088c-70d8-412d-ad3f-33900c0283a5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083703 May 26 21:54:11.922837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1398/2782] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:12.134843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:12.135486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:12.142043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:12.142499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:12.143274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:12.143719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:12.276811 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:12.285436 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5e024629-3e1e-446e-8597-e7b89dab9c44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154610 May 26 21:54:12.286020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1385/2783] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:12.939589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:12.940196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:12.946927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:12.947378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:12.948145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:12.948604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:13.009288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:13.017745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a427daf1-a672-459b-8ff1-12243c0e4649 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082580 May 26 21:54:13.018305 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1399/2784] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:13.303521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:13.304145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:13.310724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:13.311181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:13.311942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:13.312383 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:13.441240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:13.449121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-48772664-42ef-4a11-aef2-2ea49975a088 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149569 May 26 21:54:13.449697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1386/2785] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:14.035264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:14.035906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:14.042342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:14.042783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:14.043530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:14.043963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:14.106959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:14.115215 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cd9356e1-78aa-4919-aa3b-f4d2e3c053be tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084415 May 26 21:54:14.115788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1400/2786] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:14.466452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:14.467021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:14.473407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:14.473855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:14.474610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:14.475044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:14.604056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:14.612192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-465f49fd-0177-45b3-88f2-a61e9873c038 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149657 May 26 21:54:14.612802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1387/2787] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:15.132011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:15.132644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:15.139141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:15.139571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:15.140316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:15.140773 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:15.200965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:15.209076 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8743d4c1-5ee6-4220-9e2f-7599f32a7281 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080945 May 26 21:54:15.209655 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1401/2788] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:15.629888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:15.630498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:15.637055 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:15.637509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:15.638265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:15.638705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:15.770793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:15.778598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-178e6864-3fe8-47f1-a2ab-9c5e38db6d27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152642 May 26 21:54:15.779159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1388/2789] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:16.233404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:16.234011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:16.241623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:16.242066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:16.242812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:16.243239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:16.305095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:16.313913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0a4b991e-a9e2-4575-9bf6-5e357a00dcfc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084360 May 26 21:54:16.314472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1402/2790] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:16.796780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:16.798061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:16.804885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:16.805342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:16.806115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:16.806553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:16.938493 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:16.946667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-41ab8015-6581-448b-83e5-ad6504148c5a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153783 May 26 21:54:16.947247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1389/2791] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:17.332015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:17.332770 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:17.339633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:17.340083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:17.340874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:17.341314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:17.406866 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:17.414924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-84348e1b-5670-4e5a-b02a-ed8939806461 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087498 May 26 21:54:17.415511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1403/2792] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:17.965224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:17.965860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:17.972349 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:17.972841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:17.973608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:17.974100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:17.989078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:18.104746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:18.113492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bff0d9e7-9d86-442e-a435-7ab1d709815e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152210 May 26 21:54:18.114065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1390/2793] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:18.431802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:18.432427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:18.439031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:18.439481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:18.440238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:18.440700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:18.500967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:18.508916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-50cba3c3-4920-41a8-a001-a0d202482de6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080958 May 26 21:54:18.509481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1404/2794] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:19.131830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:19.132427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:19.139206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:19.139659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:19.140420 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:19.140954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:19.270864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:19.278694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c3d7db4a-5657-469a-9ce1-d1218c0163d2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150721 May 26 21:54:19.279323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1391/2795] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:19.526929 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:19.527536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:19.535498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:19.535958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:19.536796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:19.537238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:19.541395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:19.599617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:19.607694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bcbc2230-5124-454b-9201-fecb6d9e8aa3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084884 May 26 21:54:19.611694 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1405/2796] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:20.296087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:20.296815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:20.303828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:20.304284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:20.305080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:20.305514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:20.434328 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:20.442766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8192f9ea-7146-4953-a695-5d425b04f71f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150546 May 26 21:54:20.443338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1392/2797] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:20.625005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:20.625624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:20.632288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:20.632783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:20.633547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:20.633988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:20.698733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:20.707269 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-49def9e7-fda5-4f30-ba58-6ce53a0173b5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086161 May 26 21:54:20.707837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1406/2798] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:21.460515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:21.461165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:21.467714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:21.468174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:21.468987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:21.469429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:21.593926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:54:21.594199 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:54:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc (ip 10.222.0.66) !!! May 26 21:54:21.615114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:21.623338 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ecf64c1e-99a4-429e-9ee5-e0af3ad95326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.166689 May 26 21:54:21.623894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1393/2799] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:21.723928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:21.724739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:21.731554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:21.732019 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:21.732781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:21.733219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:21.796049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:21.804041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-160d8100-09ab-459b-bf49-7671812f3a28 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084657 May 26 21:54:21.804618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1407/2800] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:22.640819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:22.641423 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:22.648505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:22.648988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:22.649799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:22.650242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:22.780761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:22.788706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f166a7e0-fa40-4d39-bf65-36b1123d13b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151785 May 26 21:54:22.789275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1394/2801] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:22.821117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:22.821742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:22.828193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:22.828677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:22.830044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:22.830487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:22.890443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:22.898959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bb7e2522-6441-47b0-9106-3e4c2493fd0f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081684 May 26 21:54:22.899521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1408/2802] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:23.806125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:23.806743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:23.813364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:23.813821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:23.815240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:23.815683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:23.915479 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:23.916153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:23.922609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:23.923058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:23.924365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:23.924802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:23.943392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:23.951387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6cb915f4-4528-4d4c-8eb0-b780e0bf0084 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149138 May 26 21:54:23.951968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1395/2803] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:23.992083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:24.000042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c4413cd7-d4f7-4e4d-8c8f-61e623256260 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088591 May 26 21:54:24.000631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1409/2804] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:24.968772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:24.969400 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:24.976121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:24.976659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:24.977438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:24.977890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:25.017384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:25.018584 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:25.025227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:25.025686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:25.026468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:25.026907 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:25.098237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:25.106427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-27c707b2-d915-469e-9e6f-634c63b36de8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.092785 May 26 21:54:25.107396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1410/2805] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:25.129380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:25.137380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-07ee4eaf-732d-4f8f-ac2e-f73c0e39395d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.172596 May 26 21:54:25.137958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1396/2806] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:26.123965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:26.124627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:26.131993 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:26.132445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:26.133244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:26.133683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:26.156195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:26.157045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:26.163515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:26.163980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:26.164855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:26.165274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:26.194889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:26.203249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-47205130-9fe2-436c-a749-4bf602724c5b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083119 May 26 21:54:26.203834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1411/2807] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:26.296076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:26.304704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-18331021-44f7-40a7-bc61-1f2aa1738665 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152329 May 26 21:54:26.305273 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1397/2808] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:27.220015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:27.220650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:27.227100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:27.227544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:27.228287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:27.228752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:27.288919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:27.296647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-03a83de7-15c2-4685-8b0c-e73603fef0f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080430 May 26 21:54:27.297203 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1412/2809] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:27.321797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:27.322422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:27.328486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:27.328979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:27.329743 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:27.330827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:27.594734 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:27.602643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba1d6c2d-dad3-4922-9861-2c23fe081335 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.284886 May 26 21:54:27.603210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1398/2810] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:28.313613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:28.314250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:28.320738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:28.321184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:28.321936 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:28.322367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:28.444482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:28.452401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e69f18e5-40ea-4e03-9619-e992e37c3af2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.142683 May 26 21:54:28.453001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1413/2811] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:28.621060 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:28.621600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:28.628631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:28.629084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:28.629853 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:28.630318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:28.757732 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:28.765678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0779ee19-610a-42ed-8cae-38a1ed30cdcd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148669 May 26 21:54:28.766251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1399/2812] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:29.469336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:29.469960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:29.476467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:29.476960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:29.477723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:29.478162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:29.539397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:29.547394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7ab216ab-d986-48b3-965b-66e4ca49b449 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081927 May 26 21:54:29.547960 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1414/2813] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:29.784025 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:29.784719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:29.791279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:29.791731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:29.792491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:29.792965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:29.925492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:29.933502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-aef5412b-88b5-45e6-a1c6-c6ceed7cabf7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153993 May 26 21:54:29.935954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1400/2814] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:30.564347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:30.565095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:30.571517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:30.571970 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:30.572776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:30.573217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:30.638533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:30.646876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-38901c50-103e-4bcf-bdf4-f7a5f4f7cacb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086303 May 26 21:54:30.647477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1415/2815] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:30.951578 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:30.952244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:30.959439 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:30.959888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:30.960677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:30.961118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:31.086790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:31.094745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae087522-a799-41b8-a7f3-4130c6906d36 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147046 May 26 21:54:31.095308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1401/2816] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:31.663321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:31.663925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:31.670545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:31.670995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:31.671757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:31.672193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:31.735497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:31.744030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c95d3b81-25ad-41a0-a63f-c1dbf58f1242 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084511 May 26 21:54:31.744627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1416/2817] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:31 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:31.894976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:54:31.895162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:54:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:54:32.111802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:32.112467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:32.119822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:32.120282 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:32.121076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:32.121520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:32.248504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:32.256496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a08b763d-d63f-4881-80ee-07a077710bd8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148726 May 26 21:54:32.257093 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1402/2818] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:32.761334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:32.761983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:32.768437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:32.768917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:32.769679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:32.770116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:32.830704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:32.838782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8975020-3e27-4dc3-abb5-a86139783e80 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081346 May 26 21:54:32.839564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1417/2819] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:33.273335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:33.273954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:33.280442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:33.280927 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:33.281684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:33.282125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:33.410664 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:33.419561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-63c5a5b6-66c2-4f45-bad5-1bcafbfbb514 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150064 May 26 21:54:33.420189 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1403/2820] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:33 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:33.856041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:33.856714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:33.859009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:33.864062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:33.864522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:33.865314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:33.865758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:33.927935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:33.935941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7f0d8c49-53d8-40dd-911f-9fb479568fb7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083800 May 26 21:54:33.936535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1418/2821] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:34.438675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:34.439303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:34.445786 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:34.446231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:34.446979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:34.447412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:34.575104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:34.583913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5966864c-c97d-4ed8-9338-520295efe1de tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149137 May 26 21:54:34.584489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1404/2822] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:34.953362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:34.953985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:34.960535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:34.961023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:34.961786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:34.962227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:35.025200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:35.034038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-841cc5e4-9cca-42a5-a74e-ea5a4817f1e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084504 May 26 21:54:35.034613 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1419/2823] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:35.601721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:35.602345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:35.608889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:35.609352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:35.610119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:35.610559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:35.738279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:35.746545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61f95750-6b6a-46ba-aa90-293e26680fca tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149237 May 26 21:54:35.747294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1405/2824] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:36.051360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:36.051971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:36.058432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:36.058874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:36.059622 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:36.060059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:36.120674 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:36.129031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d3825c6d-1fc1-4ed9-b818-9f2fb5e37d19 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081622 May 26 21:54:36.129589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1420/2825] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:36.764024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:36.764673 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:36.771919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:36.772375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:36.773245 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:36.773687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:36.906623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:36.914613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c5e1f41-f427-4eb3-99e6-c06372ab0b48 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154807 May 26 21:54:36.915186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1406/2826] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:37.146005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:37.146601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:37.153221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:37.153669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:37.154436 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:37.154871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:37.217212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:37.220891 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:37.225442 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-35fdabfc-a65e-449a-954e-26be9ee29857 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083414 May 26 21:54:37.226014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1421/2827] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:37.931889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:37.932471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:37.938977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:37.939433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:37.940198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:37.940668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:37.944519 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:38.068335 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:38.076384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-34482776-9bcc-4e75-b496-8a201b68064d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148570 May 26 21:54:38.076997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1407/2828] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:38.242894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:38.243497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:38.250197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:38.250652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:38.251413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:38.251851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:38.316575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:38.324503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-87e1f925-478f-49b9-82ad-ded8c1b22089 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086093 May 26 21:54:38.325100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1422/2829] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:39.094594 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:39.095287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:39.102229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:39.102682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:39.103434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:39.103866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:39.231005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:39.239908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-90d15a04-990c-4f9c-9e92-5ee96857dcf6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149198 May 26 21:54:39.240480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1408/2830] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:39.342065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:39.342681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:39.349922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:39.350310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:39.351074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:39.351540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:39.412503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:39.420383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a7fbbbbb-da53-4043-bef9-69bdd63d6c59 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082249 May 26 21:54:39.420968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1423/2831] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:39.979121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:54:39.979360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 21:54:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:54:40.257615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:40.258298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:40.265083 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:40.265543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:40.266310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:40.266753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:40.394745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:40.402782 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3960442-c6c5-4024-a88d-5fb9dc4b3ba4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149648 May 26 21:54:40.403351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1409/2832] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:40 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:40.436186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:40.436831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:40.443934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:40.444386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:40.445191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:40.445631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:40.506843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:40.519626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0bbc727a-ad22-4f44-adce-680417936337 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082440 May 26 21:54:40.519626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1424/2833] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:41.419221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:41.419923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:41.422242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:41.426963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:41.427417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:41.428176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:41.428636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:41.535119 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:41.543132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:41.543132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:41.543132 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:41.543485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:41.543830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:41.559126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:41.567156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0df05534-69a6-49de-b706-27577e5bded4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151776 May 26 21:54:41.567726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1410/2834] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:41.608744 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:41.617106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-30b59771-8b1c-4618-bc7b-71fba32e4c9d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.086395 May 26 21:54:41.617688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1425/2835] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:42.584487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:42.585128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:42.591585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:42.592031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:42.592819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:42.593249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:42.634816 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:42.635560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:42.642435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:42.642931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:42.643763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:42.644235 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:42.711256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:42.719349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-844471c3-6879-45f7-b297-f9b64fefcbb9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088385 May 26 21:54:42.719930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1426/2836] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:42.747865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:42.756023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-25cde4e7-b756-4a76-8068-5b336d8be622 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.175388 May 26 21:54:42.756597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1411/2837] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:43.736992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:43.737612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:43.744533 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:43.745030 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:43.745795 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:43.746231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:43.773869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:43.774480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:43.780996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:43.781443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:43.782202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:43.782634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:43.807151 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:43.815663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6fd05aec-7b89-457a-ad24-8365d237d8db tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082157 May 26 21:54:43.816245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1427/2838] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:43 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:43.913350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:43.921320 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e05b2b2-797a-400f-a3fe-e1e0649c1cc3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151206 May 26 21:54:43.921901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1412/2839] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:44.832316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:44.832924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:44.839481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:44.839942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:44.840711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:44.841137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:44.903858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:44.912515 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-860ad95d-dfb1-4425-b4a2-c394c9ecad49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084632 May 26 21:54:44.913118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1428/2840] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:44.938968 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:44.939591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:44.946077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:44.946539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:44.947307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:44.947750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:45.076075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:45.084714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f866d1be-07af-468d-9ed5-b4299f7a4102 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149429 May 26 21:54:45.085220 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1413/2841] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:45.930004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:45.930586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:45.936997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:45.937437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:45.938182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:45.938609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:46.086751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:46.086751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1b53c183-3133-4c19-9add-5ada2b90232d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083579 May 26 21:54:46.086751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1429/2842] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:46.103567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:46.104239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:46.111667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:46.112160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:46.113018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:46.113738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:46.247589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:46.255524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a9777107-1aba-498d-a215-7d03550e5bba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.156908 May 26 21:54:46.256091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1414/2843] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:47.026507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:47.027116 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:47.033631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:47.034740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:47.035508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:47.035952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:47.095162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:47.103706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c159cd82-71a5-4999-95f4-67dce8a7478d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081108 May 26 21:54:47.104273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1430/2844] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:47.273484 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:47.274139 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:47.280945 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:47.281345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:47.282100 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:47.282542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:47.662322 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:47.670630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4603e7ab-f99b-4a95-b38c-7c22b0ad4f8c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.401000 May 26 21:54:47.671211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1415/2845] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:47 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:48.120342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:48.121079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:48.127587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:48.128039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:48.128837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:48.129279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:48.191024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:48.198909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f4aab92b-4378-419b-946b-f3ce2390be83 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082458 May 26 21:54:48.199469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1431/2846] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:48.688623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:48.689252 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:48.695801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:48.696259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:48.697062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:48.697498 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:48.825619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:48.834099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7958d7ee-9499-4586-a8c3-274ebf1274b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149453 May 26 21:54:48.834666 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1416/2847] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:49.215278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:49.215851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:49.222086 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:49.222538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:49.223297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:49.223736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:49.285817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:49.293739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-97735cea-730f-4ad5-a5da-d9919488e6f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082380 May 26 21:54:49.294304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1432/2848] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:49.851919 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:49.852459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:49.859073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:49.859527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:49.860298 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:49.860772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:49.985694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:49.993864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-4761ac23-6e0b-49e0-9408-1a0328ac332e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145936 May 26 21:54:49.994428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1417/2849] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:50.311111 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:50.311733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:50.319184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:50.319640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:50.320406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:50.320882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:50.381227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:50.389394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-58332382-cc8f-4a05-b77f-675dce07f77f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082052 May 26 21:54:50.389979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1433/2850] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:51.011166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:51.011815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:51.019159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:51.019621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:51.020398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:51.020886 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:51.151306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:51.159360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5b9f0d80-4b89-4af7-beb7-ed6dd54ac885 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152045 May 26 21:54:51.159940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1418/2851] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:51.407221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:51.407762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:51.414353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:51.414812 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:51.415577 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:51.416020 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:51.476137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:51.483979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f221cc31-3112-493a-bfca-2fddd0d6329b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080751 May 26 21:54:51.484548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1434/2852] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:52.177531 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:52.178064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:52.184459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:52.184940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:52.185697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:52.186134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:52.314057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:52.322449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cf6789ee-46a4-4fdf-b51d-2bf59c3dbc3f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149467 May 26 21:54:52.323022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1419/2853] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:52.501574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:52.502197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:52.508845 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:52.509298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:52.510064 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:52.510507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:52.577122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:52.585558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-189ff88c-36ee-4dd3-b373-324e3b17635c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087864 May 26 21:54:52.586131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1435/2854] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:53.339808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:53.340421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:53.347085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:53.347537 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:53.348312 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:53.348778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:53.475589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:53.483672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-752cc3b2-a0d6-4b62-86c2-97428af7f776 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147781 May 26 21:54:53.484240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1420/2855] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:53.602311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:53.602848 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:53.609525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:53.609978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:53.610746 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:53.611193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:53.672653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:53.681196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9e2191bf-9103-40a8-9d04-f7d25598dae2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082788 May 26 21:54:53.681760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1436/2856] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:54.501363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:54.501979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:54.508542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:54.509031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:54.509956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:54.510404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:54.641232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:54.649746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-17383a73-f679-44db-997b-6e861ddb19ab tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152219 May 26 21:54:54.650309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1421/2857] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:54 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:54.699014 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:54.699754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:54.706808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:54.707250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:54.708005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:54.708439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:54.770083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:54.778065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-47ae4ef5-9fc1-49a7-b86b-344502c044c0 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082942 May 26 21:54:54.778635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1437/2858] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:54 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:55.667569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:55.668188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:55.675347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:55.675797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:55.676562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:55.677030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:55.795065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:55.795779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:55.802906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:55.803495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:55.804255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:55.804723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:55.805988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:55.814395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9ad2740c-7203-4e46-9a0c-d900d4bfc4b5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150846 May 26 21:54:55.814902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1422/2859] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:55.823578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:55.870407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:55.878237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-864e7575-613d-4d1b-b066-4e78998b9d98 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087262 May 26 21:54:55.878794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1438/2860] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:56.832239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:56.832815 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:56.839261 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:56.839711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:56.840468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:56.840938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:56.897098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:56.897723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:56.904958 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:56.905407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:56.906201 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:56.906641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:56.976761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:56.984620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-076e22cb-caab-4b9f-81c9-7df6e2b4aaf9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091988 May 26 21:54:56.985385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1439/2861] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:56.998216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:57.000369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:54:57.007099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f482c32e-b0e0-4602-bca9-e439ca69250e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.179384 May 26 21:54:57.007658 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1423/2862] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:58.001678 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:58.002297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:58.008788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:58.009240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:58.010000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:58.010441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:58.031292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:58.031914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:58.039122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:58.039577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:58.040347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:58.040822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:58.072951 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:58.081638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-85321976-37dc-4c77-943c-083a34ff8296 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083769 May 26 21:54:58.082216 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1440/2863] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:58.172525 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:58.180575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e4c436a7-a3ee-4be6-9b9b-ffe7c8f43e2a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153266 May 26 21:54:58.181168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1424/2864] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:54:59.098273 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:59.098887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:59.105380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:59.105832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:59.106583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:59.107013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:59.168437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:59.176885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a685d48c-3222-4c59-b4a6-ccc7d45b44f8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082449 May 26 21:54:59.177456 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1441/2865] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:54:59.197046 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:54:59.197700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:54:59.204253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:59.204769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:59.205536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:54:59.205979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:54:59.332276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:54:59.340266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-40302547-8afe-45e2-9f53-bc28c9355c12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147153 May 26 21:54:59.340878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1425/2866] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:54:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:00.194165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:00.194788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:00.201359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:00.201817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:00.202598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:00.203038 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:00.269021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:00.277082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d9f64879-d430-4c0e-be1d-ac665202cf51 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087283 May 26 21:55:00.277646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1442/2867] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:00.358015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:00.358632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:00.365917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:00.366372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:00.367135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:00.367575 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:00.497144 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:00.505539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-32c9dcd3-a5c6-4d9e-95b1-ee7bddd2b82f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151362 May 26 21:55:00.506102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1426/2868] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:01.294012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:01.294629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:01.301331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:01.301786 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:01.302553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:01.302995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:01.364653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:01.372590 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-750ac561-c8a3-4ae2-aa22-428a4dc93b81 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082593 May 26 21:55:01.373174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1443/2869] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:01.522727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:01.523339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:01.529941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:01.530385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:01.531132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:01.531565 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:01.661591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:01.669674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-da3fc0ba-7f1c-4710-b41b-25b70fb390c3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150774 May 26 21:55:01.670269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1427/2870] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:01 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:02.389571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:02.390187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:02.396751 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:02.397207 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:02.397996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:02.398437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:02.465924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:02.475589 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-99d0100a-dcce-4fca-b51a-7a1b34c9c1e4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.089842 May 26 21:55:02.476166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1444/2871] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:02.687506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:02.688035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:02.694990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:02.695452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:02.696242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:02.696717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:02.838253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:02.847150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-97a732f3-6628-45a4-b49b-e2d7f8acbb27 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.163903 May 26 21:55:02.847730 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1428/2872] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:03.493785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:03.494437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:03.501043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:03.501503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:03.502961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:03.503353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:03.566887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:03.574992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-91082070-ca3e-47d8-9427-644963c7564b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085112 May 26 21:55:03.575568 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1445/2873] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:03.865779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:03.866391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:03.872855 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:03.873305 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:03.874061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:03.874496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:03.999601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:04.008095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-355c161a-a337-4150-b8fa-4c6be036c281 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147088 May 26 21:55:04.008688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1429/2874] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:04.591380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:04.591999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:04.594343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:04.599595 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:04.600052 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:04.600849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:04.601292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:04.662604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:04.670461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a28e50eb-1c8a-402b-983a-9b11384ce7ef tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083057 May 26 21:55:04.671023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1446/2875] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:05.026941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:05.027591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:05.034669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:05.035119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:05.035881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:05.036319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:05.170176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:05.178800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f43e7075-5041-4cb5-b63e-b9dd7c8ca08f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.155751 May 26 21:55:05.179377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1430/2876] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:05.687280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:05.687906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:05.694506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:05.694965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:05.695732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:05.696173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:05.757117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:05.765072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-873336cf-acc7-4b22-9357-8a2c0ffba520 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081717 May 26 21:55:05.765637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1447/2877] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:06.196418 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:06.197069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:06.203555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:06.204009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:06.204799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:06.205821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:06.331643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:06.339496 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-337a24fe-f9a5-499e-90e5-69541ebd5b25 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146940 May 26 21:55:06.340070 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1431/2878] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:06.782556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:06.783672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:06.790322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:06.790778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:06.791543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:06.791987 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:06.857661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:06.866492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-12be0f05-5cd6-4687-9abb-bd87deb71d14 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087834 May 26 21:55:06.867058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1448/2879] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:06 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:07.356904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:07.357454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:07.364140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:07.364719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:07.365487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:07.365925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:07.491714 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:07.499623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e1eeb53-a8de-49df-b172-a0fe08300f61 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146680 May 26 21:55:07.500173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1432/2880] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:07.883841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:07.884463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:07.891037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:07.891489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:07.892248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:07.892714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:07.952082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:07.959989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1a7eb9a7-fadc-42d2-857e-d93d064f5b22 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080087 May 26 21:55:07.960551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1449/2881] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:08.517354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:08.517973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:08.524382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:08.524860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:08.525620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:08.526057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:08.657119 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:08.665536 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5c605e6e-853e-47e0-b1c5-7af7260575b0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152001 May 26 21:55:08.666102 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1433/2882] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:08 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:08.977109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:08.977722 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:08.984169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:08.984640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:08.985399 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:08.985832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:09.046369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:09.054719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-22314093-1c4a-46b2-8409-4cfaa2799e49 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081460 May 26 21:55:09.055279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1450/2883] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:09.682953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:09.683577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:09.690166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:09.690628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:09.691393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:09.691838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:09.819802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:09.827788 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5786adfd-7475-46ca-b045-87f6289a541f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148848 May 26 21:55:09.828356 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1434/2884] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:10.071350 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:10.071899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:10.078353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:10.078813 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:10.079571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:10.080626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:10.143917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:10.151752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-764015ef-1b1b-468f-abcb-44cee6171f46 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084319 May 26 21:55:10.152316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1451/2885] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:10.845620 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:10.846175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:10.852741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:10.853190 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:10.853991 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:10.854425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:10.979616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:10.988243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-77dbc2b9-41a1-42b2-a126-4dd0b9a75f79 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146334 May 26 21:55:10.988836 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1435/2886] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:11.168550 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:11.169191 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:11.176141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:11.176607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:11.177375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:11.177809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:11.239797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:11.247736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ecca0e39-28cb-4494-a9e8-970dca56881a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083010 May 26 21:55:11.248424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1452/2887] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:12.005868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:12.006495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:12.008971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:12.013735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:12.014193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:12.014959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:12.015404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:12.145752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:12.153695 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a11b3b51-f481-4dfc-8123-970a309c022a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152204 May 26 21:55:12.154266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1436/2888] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:12.263732 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:12.264288 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:12.271509 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:12.271963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:12.272757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:12.273198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:12.333487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:12.341580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-10329c17-f162-40b7-b643-23b71f6eb742 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081750 May 26 21:55:12.342143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1453/2889] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:13.170856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:13.171489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:13.177976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:13.178430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:13.179192 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:13.179631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:13.304839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:13.312807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c0fc11c3-871b-428a-893d-a8da4a69f6f1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145800 May 26 21:55:13.313380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1437/2890] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:13.357965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:13.358598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:13.365276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:13.365727 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:13.366481 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:13.366917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:13.429630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:13.437398 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b513b815-3076-4377-8f30-b36c78824083 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083216 May 26 21:55:13.437961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1454/2891] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:14.330475 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:14.331096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:14.337703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:14.338160 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:14.338926 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:14.339367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:14.454435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:14.455588 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:14.462322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:14.462527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:14.463299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:14.463738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:14.464299 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:14.467766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:14.472239 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3fb5e5e8-6ed5-4cd8-80b8-8d35250e8efb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146238 May 26 21:55:14.472923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1438/2892] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:14 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:14.526522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:14.534313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a315a7f9-d8c3-4f82-9db1-5820b17f94fe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083833 May 26 21:55:14.534885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1455/2893] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:15.490640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:15.491259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:15.497687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:15.498187 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:15.498947 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:15.499390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:15.551600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:15.552204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:15.558758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:15.559424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:15.559952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:15.560383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:15.642183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:15.650016 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3068c275-d97c-4d19-876b-fbceb8659b75 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.102761 May 26 21:55:15.650597 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1456/2894] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:15.658480 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:15.666585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bdf874d2-2edc-4f5b-bbcb-dbd49c63ad20 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.180575 May 26 21:55:15.667151 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1439/2895] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:16.666754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:16.667369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:16.674531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:16.674979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:16.675733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:16.676170 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:16.684243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:16.684894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:16.691390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:16.691854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:16.692654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:16.693229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:16.707727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:16.739919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:16.748063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d8f836e6-c339-47f8-bf53-131a43200716 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085108 May 26 21:55:16.748659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1457/2896] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:16 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:16.831552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:16.839464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9dfdd640-60f4-4b1b-9742-6335ff5afe43 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.159267 May 26 21:55:16.840033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1440/2897] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:17.764895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:17.765506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:17.771897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:17.772346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:17.773129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:17.773562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:17.836844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:17.844638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e2ba49c4-5974-4f8e-aa12-1e6dd33a73ca tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083697 May 26 21:55:17.845225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1458/2898] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:17.857513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:17.858154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:17.865368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:17.865824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:17.866615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:17.867056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:18.016738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:18.027113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b729344-cfd1-4d0a-9a5a-15c1fac71eff tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.173386 May 26 21:55:18.027691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1441/2899] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:18.861292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:18.861846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:18.869090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:18.869546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:18.870315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:18.870754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:18.930681 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:18.938438 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0938ddb1-677d-4865-b262-cde7e010c81a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081216 May 26 21:55:18.939033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1459/2900] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:19.044703 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:19.045326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:19.052393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:19.052888 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:19.053672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:19.054339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:19.185195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:19.193318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ae8c68c9-eb65-4dc1-b357-a6cadd40328f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152488 May 26 21:55:19.193881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1442/2901] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:19.955147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:19.955760 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:19.962197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:19.962644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:19.963392 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:19.963823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:20.024904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:20.032707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cb33be8f-f16e-4deb-b0d3-5980de07734d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081401 May 26 21:55:20.033274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1460/2902] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:20.209776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:20.210404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:20.216970 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:20.217433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:20.218197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:20.218641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:20.344232 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:20.352685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d0b188e8-bb11-419f-a1d1-8011cbe4147b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146828 May 26 21:55:20.353255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1443/2903] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:21.049485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:21.050094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:21.056567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:21.057042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:21.057791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:21.058222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:21.121196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:21.129429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-576a7045-6d45-4d80-bb85-c28be1cbc5de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083857 May 26 21:55:21.129994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1461/2904] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:21.370486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:21.371080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:21.378140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:21.378595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:21.379355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:21.379795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:21.505207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:21.513073 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5ed002bf-51f6-4bae-b8bc-b80d652eadf5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146639 May 26 21:55:21.513654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1444/2905] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:21 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:22.145935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:22.146491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:22.153208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:22.153665 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:22.154475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:22.154914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:22.216313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:22.224832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-cc3b84a1-9af5-4618-aa28-925eeb837ead tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083340 May 26 21:55:22.225395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1462/2906] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:22.530559 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:22.531170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:22.537869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:22.538315 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:22.539069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:22.539504 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:22.668274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:22.676165 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a354e62d-94de-4e03-98c5-bc9b49047b6f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149555 May 26 21:55:22.676748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1445/2907] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:23.242572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:23.243190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:23.249799 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:23.250343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:23.251127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:23.251572 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:23.312371 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:23.320378 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dac3c5e1-a978-406c-a140-ec30ab8ab811 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081765 May 26 21:55:23.320977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1463/2908] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:23.693417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:23.694023 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:23.700453 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:23.700929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:23.701726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:23.702155 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:23.831706 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:23.839605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-351af811-bdb7-400b-ae2f-c502ddc11f57 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150065 May 26 21:55:23.840181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1446/2909] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:24.337084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:24.337714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:24.344176 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:24.344656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:24.345421 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:24.345861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:24.409543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:24.417377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-87080a8e-c16d-45ff-a7f3-13b381970922 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084132 May 26 21:55:24.417946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1464/2910] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:24.857371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:24.857995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:24.865381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:24.865841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:24.866595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:24.867031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:24.991964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:24.999801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cc2f648d-9515-4043-b620-41cfe8d4566f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146314 May 26 21:55:25.000374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1447/2911] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:25.434691 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:25.435304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:25.441692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:25.442137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:25.442910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:25.443340 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:25.503939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:25.511706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-182f0c2f-7ce2-48f4-8455-66d6ba65dad4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080901 May 26 21:55:25.512262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1465/2912] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:26.017084 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:26.017647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:26.024041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:26.024499 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:26.025293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:26.025740 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:26.153645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:26.161445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c1d7c63d-0a3a-4d2a-b1f1-dd4a9a731a12 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148333 May 26 21:55:26.162013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1448/2913] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:26.528120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:26.528769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:26.536028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:26.536485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:26.537290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:26.537736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:26.599911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:26.607874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9a4caddc-2c7d-4abc-9e10-fef04f036159 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083591 May 26 21:55:26.608434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1466/2914] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:27.183114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:27.183741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:27.189884 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:27.190344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:27.191108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:27.191553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:27.322324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:27.330697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ff873f1c-78d5-427c-b24d-0174f4a5712a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151596 May 26 21:55:27.331272 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1449/2915] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:27.624890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:27.625510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:27.631930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:27.632390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:27.633183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:27.633627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:27.697075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:27.705499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-94e43eb3-15a3-42ce-931d-db32f1c1704f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084501 May 26 21:55:27.706063 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1467/2916] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:27 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:28.347234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:28.347859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:28.354413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:28.356937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:28.356937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:28.356937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:28.482229 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:28.491910 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e00606ad-ee98-4696-8916-9928c7cb23c5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148591 May 26 21:55:28.492471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1450/2917] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:28 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:28.723048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:28.723620 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:28.730210 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:28.730664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:28.731429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:28.731870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:28.794834 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:28.803323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e2169d03-371b-4fd7-9582-0d240ee719e2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084853 May 26 21:55:28.803890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1468/2918] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:28 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:29.509134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:29.509820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:29.516283 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:29.516777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:29.517545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:29.517990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:29.648880 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:29.656942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1bbdd4b2-631a-4bab-bb62-19d526dcfad8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151624 May 26 21:55:29.658044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1451/2919] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:29 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:29.820768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:29.821390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:29.827849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:29.828293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:29.829186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:29.829621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:29.889239 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:29.897102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-764de655-a971-465d-8d0b-390613cbe4d2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080126 May 26 21:55:29.897663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1469/2920] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:29 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:30.674777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:30.675390 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:30.681906 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:30.682358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:30.683117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:30.683556 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:30.807727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:30.816217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1a9c768a-fb25-409e-8768-fe95708c4b2b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145343 May 26 21:55:30.816752 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1452/2921] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:30 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:30.913913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:30.914553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:30.921295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:30.921749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:30.922512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:30.922947 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:30.984140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:30.992274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-41921df6-563a-4f06-98f7-4148fcebbba6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082257 May 26 21:55:30.992897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1470/2922] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:30 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:31.833957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:31.834570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:31.840936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:31.841387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:31.842140 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:31.842571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:31.974181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:31.981956 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8c551d75-a160-4891-9f99-1c4a8cfb362a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151807 May 26 21:55:31.982515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1453/2923] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:31 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:32.010023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:32.010643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:32.017616 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:32.018067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:32.018849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:32.019287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:32.079873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:32.083323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:32.088028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ebf2b5da-ec29-4dde-9d18-95906cf7dc41 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081788 May 26 21:55:32.088617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1471/2924] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:32 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:32.999747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:33.000359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:33.007767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:33.008221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:33.009024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:33.009464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:33.113397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:33.114046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:33.120899 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:33.121353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:33.122120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:33.122554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:33.140354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:33.148972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-56988b64-ec16-43cf-9611-fcb7ab2a9660 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.153028 May 26 21:55:33.149554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1454/2925] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:32 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:33.193844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:33.193844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-70ad9359-05d4-440c-a812-61b50725a964 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084334 May 26 21:55:33.194074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1472/2926] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:33 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:34.166650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:34.167382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:34.173908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:34.174362 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:34.175133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:34.175577 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:34.210578 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:34.211268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:34.218415 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:34.218988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:34.220466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:34.221222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:34.290671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:34.298767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1a3ab28e-1ffe-4d32-814d-f3dfd1b6b12b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.091953 May 26 21:55:34.299347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1473/2927] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:34 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:34.324147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:34.332567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3ba74583-47ce-464f-a39b-9000e7cde1b2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.170004 May 26 21:55:34.333146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1455/2928] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:34 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:35.316001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:35.316643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:35.318935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:35.323652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:35.324105 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:35.324909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:35.331001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:35.349043 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:35.349700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:35.356237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:35.356738 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:35.357517 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:35.357967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:35.390988 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:35.399604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c20d4446-3f44-41be-996c-93d4095b0175 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.088034 May 26 21:55:35.400177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1474/2929] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:35 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:35.483937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:35.492037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-53484fc3-47c1-426c-aab9-07af1a97b4a4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146799 May 26 21:55:35.492674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1456/2930] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:35 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:36.416738 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:36.417356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:36.424314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:36.424794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:36.425553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:36.425989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:36.488168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:36.495949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aec0c7dd-c532-4ea2-8e46-6a0056df025a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083139 May 26 21:55:36.496512 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1475/2931] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:36 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:36.509647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:36.510270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:36.516912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:36.517372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:36.518138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:36.518583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:36.521121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:36.649729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:36.657754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3379ef10-70d5-4242-8417-1765de72d22b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.151987 May 26 21:55:36.658359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1457/2932] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:36 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:37.513419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:37.514062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:37.520474 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:37.520969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:37.521712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:37.522147 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:37.582322 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:37.590672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b407dcbc-f8b5-4339-a500-97bac1db9546 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081068 May 26 21:55:37.591228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1476/2933] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:37 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:37.675433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:37.676051 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:37.682562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:37.683009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:37.683769 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:37.684206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:37.811380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:37.819330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b8147f59-df1d-46a6-b8ac-0179647b4ecf tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148271 May 26 21:55:37.819900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1458/2934] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:37 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:38.607146 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:38.607809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:38.614528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:38.614974 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:38.615723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:38.616153 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:38.679457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:38.687292 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c7b1b4c9-a5b7-42d1-9ccd-faac7b1c8c76 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083978 May 26 21:55:38.687847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1477/2935] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:38 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:38.836125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:38.836741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:38.843197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:38.843655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:38.845020 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:38.845472 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:38.972986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:38.980845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-69a986fd-1b7b-4df9-9289-b9b67208789b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148616 May 26 21:55:38.981410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1459/2936] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:38 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:39.703241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:39.703878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:39.710321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:39.710766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:39.711521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:39.711986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:39.772346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:39.780121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c0be23e1-e760-460a-b6b3-dcb4e4c5b463 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080796 May 26 21:55:39.780714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1478/2937] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:39 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:39.998288 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:39.998913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:40.005917 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:40.006372 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:40.007136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:40.007606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:40.135285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:40.143193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f9a3dec5-f987-4e82-b895-8fa6c0592f4b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148839 May 26 21:55:40.143758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1460/2938] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:39 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:40.797108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:40.798329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:40.804952 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:40.805404 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:40.806165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:40.806612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:40.867177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:40.875131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-21044e48-efde-4c0a-a937-42e6a9ad84fd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081905 May 26 21:55:40.875703 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1479/2939] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:40 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:41.160851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:41.161429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:41.167746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:41.168201 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:41.171269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:41.171269 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:41.298883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:41.306810 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a7a7aaf0-7111-42a6-8c1c-10387195633e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150484 May 26 21:55:41.307393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1461/2940] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:41 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:41.891687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:41.892295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:41.898764 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:41.899214 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:41.899959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:41.900388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:41.962966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:41.971402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f1dc2705-c46a-46bd-a2c7-3e8e8f4cde1e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084074 May 26 21:55:41.971961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1480/2941] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:41 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:42.324617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:42.325391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:42.328124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:42.333675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:42.334166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:42.334934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:42.335377 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:42.465213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:42.472981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-595b1604-d23f-457a-be03-e2150bc6b652 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.152306 May 26 21:55:42.473553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1462/2942] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:42 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:42.988300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:42.988955 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:42.995425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:42.995881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:42.996669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:42.997110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:43.060470 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:43.065556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0e908931-7c4b-4a6a-8884-96aa91dd4a0d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081956 May 26 21:55:43.066126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1481/2943] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:42 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:43.490603 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:43.491218 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:43.498121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:43.498569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:43.499319 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:43.499755 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:43.632767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:43.640693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f4c58c61-8e08-4ec2-8e05-a517cd67d544 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.154217 May 26 21:55:43.641845 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1463/2944] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:43 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:44.082459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:44.083015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:44.089575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:44.090034 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:44.090797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:44.091240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:44.153591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:44.161482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b4095a25-8d1e-48af-b820-898fabb864d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083013 May 26 21:55:44.162053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1482/2945] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:44 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:44.659028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:44.659827 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:44.666425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:44.666876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:44.667642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:44.668081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:44.793562 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:44.801346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ec50b7b0-9c2f-480c-b00e-6c359c054b1f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146864 May 26 21:55:44.801913 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1464/2946] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:44 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:45.178075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:45.178686 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:45.185295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:45.185739 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:45.186482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:45.186909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:45.251536 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:45.259723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8555d871-a936-456d-8aff-ebea93e210f7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085403 May 26 21:55:45.260459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1483/2947] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:45 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:45.818502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:45.819091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:45.825605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:45.826054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:45.826813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:45.827248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:45.953069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:45.960948 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3b6abcea-7c80-4b6d-b893-1b895eea1ca1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146362 May 26 21:55:45.961515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1465/2948] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:45 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:46.277484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:46.278099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:46.285319 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:46.285762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:46.286508 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:46.286941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:46.346507 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:46.354311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5b527aa5-a0c5-4a82-966a-fd2552fb4d8a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080655 May 26 21:55:46.354871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1484/2949] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:46 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:46.978637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:46.979188 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:46.986197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:46.986912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:46.987682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:46.988129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:47.116445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:47.124343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bf201dde-d645-4647-bc41-0c5b357851bb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149679 May 26 21:55:47.124951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1466/2950] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:46 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:47.371183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:47.371807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:47.378528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:47.378971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:47.379779 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:47.380212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:47.440131 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:47.447847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8e0ed351-7f79-4e1d-861c-18f0e2f5526d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080559 May 26 21:55:47.448403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1485/2951] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:47 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:48.142699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:48.143257 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:48.149758 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:48.150211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:48.150967 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:48.151409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:48.275551 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:48.283381 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9bf2acec-5673-47d3-86d2-f7193c41228f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145187 May 26 21:55:48.283943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1467/2952] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:48 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:48.464323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:48.464892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:48.471245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:48.471689 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:48.472432 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:48.472887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:48.536173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:48.544304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a592214a-327e-4aa8-949d-d90de874c5b4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083818 May 26 21:55:48.544906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1486/2953] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:48 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:49.300942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:49.301595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:49.307987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:49.308449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:49.309247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:49.309693 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:49.435944 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:49.443914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-651f714f-d2f4-4e83-bd37-17ddb594c690 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147303 May 26 21:55:49.444483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1468/2954] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:49 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:49.561599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:49.562217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:49.569084 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:49.569534 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:49.570366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:49.570811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:49.632444 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:49.640359 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-53e75f08-9032-4195-aa53-c5170fb499ee tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082657 May 26 21:55:49.641140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1487/2955] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:49 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:50.462004 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:50.462623 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:50.469656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:50.470113 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:50.470877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:50.471324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:50.600997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:50.608915 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-844de5a4-436c-4bfe-a796-31e2094cea0e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150784 May 26 21:55:50.609494 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1469/2956] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:50 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:50.658685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:50.659293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:50.666790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:50.667234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:50.667989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:50.668419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:50.685684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:50.729500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:50.737484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-62840a86-904c-4c62-86bf-008dae50bba3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083164 May 26 21:55:50.738043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1488/2957] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:50 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:51.626429 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:51.627049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:51.633555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:51.634014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:51.634777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:51.635221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:51.754006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:51.754713 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:51.759873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:51.761489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:51.761942 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:51.762702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:51.763168 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:51.768486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0b4e3c95-03f5-4b8d-b814-ebe70fb247a5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145986 May 26 21:55:51.769104 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1470/2958] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:51 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:51.829510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:51.837428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c8b191a2-3aae-4031-a569-47956175b73c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087773 May 26 21:55:51.838462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1489/2959] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:51 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:52.786348 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:52.786978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:52.793507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:52.793965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:52.794729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:52.795170 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:52.854828 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:52.855472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:52.862172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:52.862635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:52.863400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:52.863841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:52.925756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:52.933710 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9532cccb-eb8a-4297-a229-6c5a06f2c9e3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082849 May 26 21:55:52.934275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1490/2960] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:52 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:52.946638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:52.955036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3e2faf7b-1df1-43f3-b4cd-2c8a82afa005 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.172593 May 26 21:55:52.955596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1471/2961] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:52 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:53.950700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:53.951317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:53.958385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:53.958837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:53.959596 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:53.960041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:53.972824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:53.973446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:53.979951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:53.980412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:53.981202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:53.981644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:54.024193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:54.032396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ec60e518-7e35-4941-b456-2002c3f28c03 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085855 May 26 21:55:54.033003 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1491/2962] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:54.118911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:54.139735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6b10b104-6f2b-4715-a81a-4cdc3d6f6633 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.159005 May 26 21:55:54.139735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1472/2963] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:53 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:55:55.049077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:55.049695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:55.056279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:55.056765 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:55.057520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:55.057959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:55.118123 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:55.125998 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7035d8c8-cd27-4c56-87ca-98752e80e8cd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081351 May 26 21:55:55.126565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1492/2964] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:55 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:55.155354 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:55.155978 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:55.162468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:55.162925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:55.163688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:55.164135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:55.292539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:55.294813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:55:55.301672 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8156366e-a565-42a6-a4e6-c93965be2c54 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150067 May 26 21:55:55.302182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1473/2965] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:55 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:56.141982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:56.142598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:56.149188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:56.149641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:56.150394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:56.150829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:56.213202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:56.221552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1169b91a-72fe-4470-b926-71ca15d7036e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083438 May 26 21:55:56.222114 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1493/2966] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:56 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:56.318391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:56.319038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:56.326013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:56.326467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:56.327233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:56.327677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:56.451323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:56.459213 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fffe6f91-9e4d-429e-b939-e735366dd8fd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.144678 May 26 21:55:56.459781 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1474/2967] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:56 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:57.238693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:57.239312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:57.245823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:57.246275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:57.247032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:57.247472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:57.307449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:57.316097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-78e38939-a867-48e0-8733-70a6f8512c06 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081553 May 26 21:55:57.316682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1494/2968] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:57 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:57.476820 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:57.477446 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:57.483607 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:57.484608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:57.485368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:57.485813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:57.614643 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:57.622534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9fce6b25-03f5-4bf9-b4c6-653f16f7c717 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149591 May 26 21:55:57.623127 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1475/2969] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:57 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:58.333233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:58.333855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:58.340335 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:58.340824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:58.341591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:58.342042 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:58.405645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:58.414165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-818cc5df-b524-4fcb-881e-9476b085a8d8 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084810 May 26 21:55:58.414734 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1495/2970] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:58 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:58.639908 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:58.641050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:58.647532 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:58.647988 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:58.648792 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:58.649234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:58.773622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:58.781638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-97f264eb-c24b-455f-974a-87af7885b25d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145610 May 26 21:55:58.782203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1476/2971] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:58 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:59.431022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:59.431630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:59.438617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:59.439065 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:59.439817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:59.440249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:59.502968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:59.510939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-acea5cd0-92b5-4928-a272-9a8bfd4e20c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083773 May 26 21:55:59.511499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1496/2972] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:59 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:55:59.799365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:55:59.799993 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:55:59.806591 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:59.807323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:59.808089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:55:59.808535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:55:59.933266 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:55:59.941749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4c979d5-8cb4-46f4-91de-83c841e02133 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146859 May 26 21:55:59.942318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1477/2973] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:55:59 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:00.527567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:00.528177 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:00.535483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:00.535944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:00.536740 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:00.537183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:00.598778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:00.606843 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b426c5bb-37f5-4992-bcd9-a91a610ac3da tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083086 May 26 21:56:00.607408 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1497/2974] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:00 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:00.959028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:00.959574 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:00.966185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:00.966639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:00.967403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:00.967840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:01.096414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:01.104205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-263d760a-1683-4d87-9354-12a03d47f454 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149178 May 26 21:56:01.104787 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1478/2975] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:00 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:01.623780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:01.624448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:01.630923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:01.631370 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:01.632125 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:01.632562 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:01.692189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:01.699995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9fb4f676-f593-4168-ac33-2092cf3f5581 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080076 May 26 21:56:01.700558 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1498/2976] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:01 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:02.121427 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:02.122045 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:02.129208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:02.129668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:02.130433 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:02.130879 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:02.254576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:02.262476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-8dd36c07-f0dd-4d1a-bf56-1eed7bf48a17 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.144891 May 26 21:56:02.263049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1479/2977] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:02 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:02.716904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:02.717522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:02.724761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:02.725213 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:02.725971 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:02.726409 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:02.789261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:02.797083 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de40bcda-f898-4bee-9959-851f02f86c73 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084129 May 26 21:56:02.797648 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1499/2978] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:02 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:03.279632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:03.280248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:03.286715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:03.287167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:03.287923 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:03.288364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:03.415350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:03.423767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-70134d44-ef81-45d9-bb9c-a56780306e8e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147980 May 26 21:56:03.424275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1480/2979] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:03 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:03.813688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:03.814300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:03.820822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:03.821270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:03.822025 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:03.822459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:03.881959 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:03.889736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-308834df-99cf-4bd9-b0b2-5b48b65586c6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.079884 May 26 21:56:03.890304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1500/2980] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:03 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:04.440256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:04.440911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:04.447541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:04.447994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:04.448795 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:04.449242 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:04.578634 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:04.586705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5a88f1e-fc52-4c7c-9326-e6966f50617f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150347 May 26 21:56:04.587275 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1481/2981] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:04 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:04.907190 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:04.907811 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:04.914372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:04.914827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:04.915586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:04.916026 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:04.976135 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:04.984417 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3a67787c-8a57-401e-925c-ca636699c510 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081773 May 26 21:56:04.985011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1501/2982] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:04 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:05.603013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:05.603654 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:05.610255 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:05.610711 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:05.611767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:05.612234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:05.737925 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:05.745731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5fe87ee2-09d7-42e5-a4cf-f97af1d2ba08 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146570 May 26 21:56:05.746297 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1482/2983] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:05 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:06.000977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:06.001601 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:06.003894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=56 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:06.008677 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:06.009137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:06.009901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:06.010343 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:06.074341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:06.082178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-51e40d83-1885-49a3-9f63-c8aca28745f5 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085060 May 26 21:56:06.082748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1502/2984] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:05 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:06.762851 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:06.763466 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:06.770521 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:06.770972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:06.771728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:06.772168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:06.898394 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:06.906291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f2edeaa3-2650-4d9e-ac94-c7001aadbc40 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147280 May 26 21:56:06.906860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1483/2985] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:06 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:07.098569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:07.099126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:07.105659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:07.106110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:07.106871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:07.107311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:07.169752 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:07.178312 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b9557194-e357-49de-8629-bec69d4b44fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083607 May 26 21:56:07.178883 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1503/2986] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:07 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:07.923421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:07.923999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:07.930424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:07.930868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:07.931612 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:07.932053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:08.058520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:08.066357 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1fc4d90e-9b93-4164-b33e-8ce1ee092726 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146923 May 26 21:56:08.066921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1484/2987] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:07 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:08.195684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:08.196232 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:08.203005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:08.203455 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:08.204209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:08.204668 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:08.264917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:08.273186 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-948c16e5-9ce0-4ea8-b181-a2d5edd1fbfa tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081428 May 26 21:56:08.273749 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1504/2988] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:08 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:09.083867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:09.084506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:09.090995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:09.091596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:09.092235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:09.092707 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:09.226898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:09.226898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f0e7e402-6489-4201-b61b-6dd7fe784a7d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.144004 May 26 21:56:09.226898 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1485/2989] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:09 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:09.290426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:09.291046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:09.297889 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:09.298356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:09.299118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:09.299561 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:09.303983 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:09.364006 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:09.371829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f62c8493-ca0c-4e3d-b87a-8278c7ce7f20 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085266 May 26 21:56:09.372396 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1505/2990] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:09 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:10.242347 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:10.242964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:10.249459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:10.249911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:10.251243 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:10.251681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:10.389488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:10.390134 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:10.396887 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:10.397328 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:10.398098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:10.398529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:10.591282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:10.599846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b3fc800d-1f39-401a-887d-6cb371cb7836 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.214265 May 26 21:56:10.600667 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1506/2991] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:10 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:10.649256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:10.657684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fdfdc002-3bcc-4a66-b98b-4b618c0253df tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.419171 May 26 21:56:10.658248 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1486/2992] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:10 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:11.617101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:11.617724 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:11.624143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:11.624605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:11.625416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:11.626395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:11.675365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:11.675980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:11.682459 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:11.682953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:11.683750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:11.684195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:11.687621 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:11.696024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-96f0b948-f5fb-4f39-b56a-b0e444df1ebb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082807 May 26 21:56:11.696615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1507/2993] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:11 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:11.808809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:11.817323 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-683e9c60-4a80-48f6-96eb-224f1e525cfe tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.146315 May 26 21:56:11.817835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1487/2994] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:11 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:56:12.712645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:12.713295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:12.720333 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:12.720814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:12.721581 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:12.722021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:12.784323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:12.792140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e491c028-ea39-46cb-b5b0-918bf9c5859b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083373 May 26 21:56:12.792742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1508/2995] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:12 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:12.834363 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:12.834914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:12.837290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:12.842241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:12.842701 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:12.843477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:12.843983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:12.972360 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:12.980401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-61ee7c13-3d38-465a-be1b-f6014ac19c68 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149903 May 26 21:56:12.981029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1488/2996] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:12 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:13.809525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:13.810090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:13.816563 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:13.817040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:13.817797 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:13.818237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:13.878015 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:13.886017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7d13a9a1-009b-43bb-86b7-d92328b5398d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080323 May 26 21:56:13.886583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1509/2997] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:13 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:13.997894 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:13.998533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:14.004924 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:14.005391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:14.006123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:14.006555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:14.131339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:14.138638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d6a7518a-6035-4f04-9ab6-f7cab183b54e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.144544 May 26 21:56:14.139202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1489/2998] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:13 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:14.903315 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:14.903855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:14.910324 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:14.910780 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:14.911541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:14.911980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:14.975992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:14.983963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-aad5c9ce-b254-46b5-b0e1-7a7b0432895a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084599 May 26 21:56:14.984539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1510/2999] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:14 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:15.157560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:15.158138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:15.164635 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:15.165090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:15.165846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:15.166285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:15.181223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:15.292324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:15.300789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a97c365f-fd3c-4970-b5d0-645731a77ac3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147592 May 26 21:56:15.301361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1490/3000] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:15 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:16.001934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:16.002549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:16.009018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:16.009472 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:16.010227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:16.010666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:16.071022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:16.078946 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-4af14ca0-8279-4d81-873b-20219d5baeed tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081350 May 26 21:56:16.079511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1511/3001] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:15 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:16.318375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:16.318911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:16.325365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:16.325819 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:16.326566 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:16.326999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:16.454651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:16.462409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f467f81a-1346-46c6-aaa0-81104f64bdfb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.147908 May 26 21:56:16.462964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1491/3002] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:16 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:17.094999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:17.095619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:17.102822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:17.103279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:17.104040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:17.104478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:17.164461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:17.172272 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fb3005c5-1e5a-4745-8f09-85c8eb11dc02 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081203 May 26 21:56:17.172870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1512/3003] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:17 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:17.480336 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:17.480890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:17.487628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:17.488080 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:17.488867 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:17.489301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:17.617054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:17.624999 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-88181c8d-97ee-4575-8a59-98f2f8174f6d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148622 May 26 21:56:17.626121 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1492/3004] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:17 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:18.189461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:18.189986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:18.196791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:18.197247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:18.198012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:18.198451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:18.264514 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:18.273184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-34384ea6-3e20-4c86-9ba7-90e250e189c2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.087329 May 26 21:56:18.273575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1513/3005] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:18 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:18.643428 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:18.644034 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:18.650598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:18.651047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:18.651794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:18.652231 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:18.780062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:18.787840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6911325a-62f3-4a53-a39f-0522aef4d158 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.148773 May 26 21:56:18.788641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1493/3006] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:18 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:18.862922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:56:18.863079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:56:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:56:19.289669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:19.290376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:19.296277 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:19.300930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:19.300930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:19.300930 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:19.358046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:19.366532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8390a4e1-f5dc-46b0-b2dd-d27e3f049532 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.080978 May 26 21:56:19.367090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1514/3007] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:19 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:19.804091 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:19.804745 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:19.811256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:19.811648 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:19.812403 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:19.812862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:19.942539 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:19.950441 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-662228f5-2083-411d-b564-e73d61659637 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.150219 May 26 21:56:19.951005 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1494/3008] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:19 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:20.384480 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:20.385129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:20.392299 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:20.392766 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:20.393530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:20.393975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:20.455636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:20.463521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e23561e8-e616-4199-81f9-475107392fba tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082891 May 26 21:56:20.464090 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1515/3009] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:20 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:20.967303 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:20.967955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:20.974413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:20.974865 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:20.975613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:20.976049 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:21.100774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:21.108627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e55bb565-e18b-4d31-bb87-8a4e4b494b44 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145166 May 26 21:56:21.109210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1495/3010] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:20 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:21.480919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:21.481518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:21.488805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:21.489300 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:21.490057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:21.490497 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:21.554253 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:21.562221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-83e9b8a0-7e06-4dfa-891e-342d3731aa6c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.085550 May 26 21:56:21.563367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1516/3011] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:21 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:22.126290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:22.126905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:22.133440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:22.133896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:22.134655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:22.135095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:22.259794 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:22.268143 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ba60a7e7-7b02-493f-b1df-6305eb65e320 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145840 May 26 21:56:22.268742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1496/3012] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:22.580301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:22.585094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:22.586973 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:22.587413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:22.588157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:22.588605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:22.649463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:22.657263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d76ab7ec-ffcb-4abd-ba78-f2118ada4a66 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081971 May 26 21:56:22.657827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1517/3013] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:22 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:23.285928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:23.286582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:23.293041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:23.293490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:23.294249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:23.294684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:23.424036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:23.431890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-04f55b2e-62ee-423d-8579-ac6d7f8a615d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149876 May 26 21:56:23.432445 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1497/3014] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:23 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:23.674156 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:23.674767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:23.681197 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:23.681645 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:23.682391 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:23.682821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:23.743054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:23.753401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c7735da2-1718-4e4b-b0df-cce07c96ec0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.083101 May 26 21:56:23.753985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1518/3015] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:23 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:24.447896 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:24.448515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:24.454995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:24.455452 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:24.456217 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:24.456682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:24.582059 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:24.589998 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f296cc66-eb58-490c-91d1-0e8e5bd31288 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.145945 May 26 21:56:24.590567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1498/3016] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:24 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:24.770074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:24.770685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:24.777229 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:24.777679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:24.778440 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:24.778877 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:24.841865 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:24.850356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-304aa136-c138-4354-bb11-464d876a69fc tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.084154 May 26 21:56:24.850922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1519/3017] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:24 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:25.607287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:25.607903 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:25.617033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:25.617486 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:25.618247 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:25.618686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:25.753520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:25.761464 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-65718886-4590-4559-84e9-43efbf9e0a6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.158078 May 26 21:56:25.762033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1499/3018] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:25 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:25.867434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:25.868062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:25.874599 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:25.875614 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:25.876380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:25.876837 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:25.936885 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:25.945429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-844d6a61-f20e-4595-aa88-28c4dd2d33f2 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.081892 May 26 21:56:25.945989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1520/3019] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:25 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:26.779214 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:26.779826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:26.786930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:26.787379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:26.788129 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:26.788564 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:26.916742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:26.924540 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cf091a90-e133-4fef-9ca9-7ff442b5e326 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149206 May 26 21:56:26.925171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1500/3020] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:26 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:26.962028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:26.962653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:26.969136 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:26.969580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:26.970339 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:26.970781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:27.032913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:27.036224 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=100 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:27.040966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f8baa877-94e7-439f-afce-c7132b954be4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 200 len: 1368 microversion: 2.1 time: 0.082805 May 26 21:56:27.041535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1521/3021] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:26 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 1368 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:27.065208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-26fdd7ed-ca80-4c24-9d60-416486da4da1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '.version_select at 0x7f46c836cdc0>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:27.171848 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-26fdd7ed-ca80-4c24-9d60-416486da4da1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-740393474" status: 202 len: 0 microversion: 2.1 time: 0.110850 May 26 21:56:27.172350 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1501/3022] 10.222.0.66 () {58 vars in 1217 bytes} [Thu May 26 21:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-740393474 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:56:27.942923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:27.943539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:27.949704 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:27.950166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:27.950927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:27.951402 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:28.079586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:28.087675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d25b9b50-8add-4084-9c81-53698959c1a6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 200 len: 1727 microversion: 2.1 time: 0.149287 May 26 21:56:28.088898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1522/3023] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:27 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:28.105186 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c6273733-1d32-4e8d-880e-306dc8f36033 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '.version_select at 0x7f46c844b790>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:28.139805 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-acc86dfe-2db7-420e-aae2-ad15c33c2fab tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: .version_select at 0x7f46c83249d0>, body: {"keypair": {"name": "tempest-keypair-1546269191", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGC0UvpXFAjlAhZgF4vB7rcvQ+78fvVW+z2Mrr3yxdSzBu8sF3azy99/KU2Rg1dCIWGufs0BZZIcl6QTmmP7zWfvOI1NL7BC3lVXTF8HZjQGAzKlkKU3LfL5rZRXpJ8Qng=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:28.153994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-acc86dfe-2db7-420e-aae2-ad15c33c2fab tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for project 8e24cfce792042e2b665ef2cca91b752. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:56:28.158258 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-acc86dfe-2db7-420e-aae2-ad15c33c2fab tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for user 388330e61ade4f188c40c11c4ac46fd0 and project 8e24cfce792042e2b665ef2cca91b752. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:56:28.214241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c6273733-1d32-4e8d-880e-306dc8f36033 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193779185" status: 202 len: 0 microversion: 2.1 time: 0.113275 May 26 21:56:28.214832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1502/3024] 10.222.0.66 () {58 vars in 1220 bytes} [Thu May 26 21:56:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193779185 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:56:28.300981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-acc86dfe-2db7-420e-aae2-ad15c33c2fab tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.165027 May 26 21:56:28.302115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1523/3025] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:56:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:56:29.238973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-d89618e3-7450-4ab1-a6df-ebefb7f5007e req-e4926885-338f-44f7-b393-151715258181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a593d7f5-c378-4a24-a59d-53fcf2e6ffcc", "tag": "2c2d13db-51bd-48b0-b8f7-bb7290971377"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:29.249985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d89618e3-7450-4ab1-a6df-ebefb7f5007e req-e4926885-338f-44f7-b393-151715258181 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:29.250437 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d89618e3-7450-4ab1-a6df-ebefb7f5007e req-e4926885-338f-44f7-b393-151715258181 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:29.263461 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-d89618e3-7450-4ab1-a6df-ebefb7f5007e req-e4926885-338f-44f7-b393-151715258181 service nova] Creating event network-changed:2c2d13db-51bd-48b0-b8f7-bb7290971377 for instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc on hv-cinder-82880 May 26 21:56:29.270681 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-d89618e3-7450-4ab1-a6df-ebefb7f5007e req-e4926885-338f-44f7-b393-151715258181 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101279 May 26 21:56:29.276656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1503/3026] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:56:29.441427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-231b7bc3-d982-4d69-8735-9cccb67a621b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: .version_select at 0x7f46c81fd0d0>, body: {"keypair": {"name": "tempest-keypair-871438041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNR3V0RxNNbv7QNNi44cx4fY5h8eQmrhL5oHbyDzVH63I9HaJFnSyOrWZ2Y0GTw4Ax8Zry7T3fNak89qsdYUr1jUVsr3/k5pYSKwWEIFj3XICTH8kadW+qDXf9CGvAS4Ug=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:29.465676 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-231b7bc3-d982-4d69-8735-9cccb67a621b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:56:29.471466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-231b7bc3-d982-4d69-8735-9cccb67a621b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:56:29.569924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-231b7bc3-d982-4d69-8735-9cccb67a621b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133755 May 26 21:56:29.571757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1524/3027] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:56:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:56:31.022022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-776826470", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93529f0f-54f7-46c5-b68f-8eddc26d3812"}], "security_groups": [{"name": "tempest-securitygroup--1876683472"}], "key_name": "tempest-keypair-1546269191", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:31.132399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] validate_networks() for [('93529f0f-54f7-46c5-b68f-8eddc26d3812', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:56:31.572557 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:56:31.573194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:56:31.573674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:56:31.574090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:56:31.574506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:56:31.583818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:31.584264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:31.585096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:31.585535 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:31.602501 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for project 8e24cfce792042e2b665ef2cca91b752. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:56:31.606483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Getting quotas for user 388330e61ade4f188c40c11c4ac46fd0 and project 8e24cfce792042e2b665ef2cca91b752. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:56:31.618310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:56:31.620616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:56:31.743341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0ba141a6-8fc6-4f0b-9120-57db5fa97328 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725778 May 26 21:56:31.743990 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1504/3028] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:56:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:56:31.754162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61108202-ce23-49bd-8fff-f9c8496d4ddb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:31.754784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61108202-ce23-49bd-8fff-f9c8496d4ddb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:31.814528 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-61108202-ce23-49bd-8fff-f9c8496d4ddb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:31.821743 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61108202-ce23-49bd-8fff-f9c8496d4ddb tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1237 microversion: 2.1 time: 0.071347 May 26 21:56:31.822284 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1525/3029] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:31 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:32.459477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-536129991", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e07a43e-b6dc-4850-bc07-d904a80346a4"}], "security_groups": [{"name": "tempest-securitygroup--1815023468"}], "key_name": "tempest-keypair-871438041", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:32.495717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:56:32.495861 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:56:32.562235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] validate_networks() for [('4e07a43e-b6dc-4850-bc07-d904a80346a4', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:56:32.793763 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:56:32.794310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:56:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 21:56:32.839290 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:32.840256 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:32.847352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:32.847794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:32.848546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:32.849002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:32.938297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:32.949460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-20341a20-844b-49dd-b59b-8031355db8e1 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1241 microversion: 2.1 time: 0.110324 May 26 21:56:32.949460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1526/3030] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:32 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:32.965850 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:56:32.966279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:56:32.966754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:56:32.967166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:56:32.967580 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:56:32.976200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:32.983712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:32.983712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:32.983712 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:32.994922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:56:32.998902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:56:33.010291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:56:33.012422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:56:33.121172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b5881f29-a5ce-458f-9420-956f87f6b5b6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.666517 May 26 21:56:33.122024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1505/3031] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:56:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:56:33.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b0c02f87-e419-4637-893b-33f9d38a5db3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:33.132953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b0c02f87-e419-4637-893b-33f9d38a5db3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:33.192830 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b0c02f87-e419-4637-893b-33f9d38a5db3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:33.200963 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b0c02f87-e419-4637-893b-33f9d38a5db3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1240 microversion: 2.1 time: 0.072374 May 26 21:56:33.201918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1527/3032] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:33 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:33.963916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:33.964534 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:33.972015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:33.972470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:33.973267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:33.973704 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:34.048196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:34.056031 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9ad1bf54-2df7-46da-8692-49a095b52645 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1297 microversion: 2.1 time: 0.096495 May 26 21:56:34.056837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1506/3033] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:33 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:34.218849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:34.219484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:34.227077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:34.227495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:34.228259 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:34.228733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:34.300223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:34.303349 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-85533f93-c992-4f90-8935-b2b5a0beb305 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1244 microversion: 2.1 time: 0.088527 May 26 21:56:34.303908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1528/3034] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:34 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:35.073292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:35.073844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:35.080976 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:35.081628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:35.082393 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:35.082823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:35.264090 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:35.272203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a89ebd92-9fbe-4d58-bc01-d2bf8685ca4d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.202792 May 26 21:56:35.272807 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1507/3035] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:35 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:35.319385 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:35.319995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:35.326894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:35.327546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:35.328920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:35.329363 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:35.440294 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:35.448461 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-dd4964dc-4558-482c-a940-364f5e72b80f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1300 microversion: 2.1 time: 0.132991 May 26 21:56:35.449247 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1529/3036] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:35 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:36.289424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:36.290044 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:36.297733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:36.298028 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:36.298783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:36.299223 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:36.428482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-b2484dc9-9e35-4e95-aedb-805e664a74b8 req-9179087d-5026-4412-8223-99b5ff7a632a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e664bb-6461-4713-998e-cc5d075d4458", "tag": "d8070021-a36a-4b6e-935a-a6d79c5384de"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:36.428482 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:36.436000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b2484dc9-9e35-4e95-aedb-805e664a74b8 req-9179087d-5026-4412-8223-99b5ff7a632a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:36.436666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-b2484dc9-9e35-4e95-aedb-805e664a74b8 req-9179087d-5026-4412-8223-99b5ff7a632a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:36.450164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-b2484dc9-9e35-4e95-aedb-805e664a74b8 req-9179087d-5026-4412-8223-99b5ff7a632a service nova] Creating event network-changed:d8070021-a36a-4b6e-935a-a6d79c5384de for instance 97e664bb-6461-4713-998e-cc5d075d4458 on hv-cinder-82880 May 26 21:56:36.458605 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-b2484dc9-9e35-4e95-aedb-805e664a74b8 req-9179087d-5026-4412-8223-99b5ff7a632a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038960 May 26 21:56:36.459539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1530/3037] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:56:36.477653 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:36.478495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:36.494121 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:36.494847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:36.495643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:36.496087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:36.550065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:36.562561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d3d88135-4bad-45c3-ad62-a0a5bfe5d87e tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.272906 May 26 21:56:36.562561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1508/3038] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:36 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:36.738255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:36.750255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5e33cdf8-f191-43b6-8736-6b0954a55f0f tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.281365 May 26 21:56:36.750255 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1531/3039] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:36 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:37.305235 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-93119374-ef54-4c35-bc21-175f04e5a274 req-8f6ad57b-2b8b-4715-bc9a-05c5d5bd6de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca496d3c-baab-45a8-a23c-f88eec4d16d3", "tag": "b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:37.315987 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-93119374-ef54-4c35-bc21-175f04e5a274 req-8f6ad57b-2b8b-4715-bc9a-05c5d5bd6de7 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:37.316438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-93119374-ef54-4c35-bc21-175f04e5a274 req-8f6ad57b-2b8b-4715-bc9a-05c5d5bd6de7 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:37.331206 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-93119374-ef54-4c35-bc21-175f04e5a274 req-8f6ad57b-2b8b-4715-bc9a-05c5d5bd6de7 service nova] Creating event network-changed:b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee for instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 on hv-cinder-82880 May 26 21:56:37.334198 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-93119374-ef54-4c35-bc21-175f04e5a274 req-8f6ad57b-2b8b-4715-bc9a-05c5d5bd6de7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033499 May 26 21:56:37.335153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1509/3040] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:56:37.575336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:37.575932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:37.582463 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:37.582914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:37.583675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:37.584113 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:37.712781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:37.720688 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f1998744-fb9b-4528-a6ef-e3ac886580b7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.149303 May 26 21:56:37.721250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1532/3041] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:37 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:37.765405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:37.766110 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:37.772295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:37.772785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:37.773543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:37.773981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:37.905843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:37.913885 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4ec2c15-7841-41b9-9e32-3b916b189441 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.152658 May 26 21:56:37.914454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1510/3042] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:37 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:38.738138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:38.738756 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:38.745439 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:38.745898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:38.746690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:38.747128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:38.873920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:38.881776 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6f8c4395-d399-4f6a-9420-5feb9033974d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.148340 May 26 21:56:38.882341 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1533/3043] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:38 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:38.930426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:38.931036 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:38.937477 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:38.938421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:38.939196 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:38.939628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:39.068647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:39.070930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:39.076741 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7bbd31d9-8216-4197-bb9a-6ec9e33dce7b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.150010 May 26 21:56:39.077251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1511/3044] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:38 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:39.898598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:39.899225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:39.905878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:39.906869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:39.907635 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:39.908069 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:40.036826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:40.044172 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5bcbe506-a600-4eb3-a954-9a1737111a70 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.149548 May 26 21:56:40.044768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1534/3045] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:39 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:40.093465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:40.094790 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:40.101721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:40.102177 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:40.102930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:40.103368 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:40.319733 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:40.327205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cff06c2b-9e9d-46f5-b515-24cd4392a94b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.237620 May 26 21:56:40.327779 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1512/3046] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:40 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:41.061487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:41.062109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:41.068684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:41.069144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:41.069905 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:41.070348 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:41.202821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:41.211267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-72025a5c-2746-477b-8c96-9ed24afe8b61 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.153554 May 26 21:56:41.212074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1535/3047] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:41 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:41.344843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:41.345391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:41.351801 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:41.352254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:41.353062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:41.353505 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:41.479379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:41.487029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f17d55c8-2c09-4139-9a45-8c8092c74721 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.146203 May 26 21:56:41.487598 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1513/3048] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:41 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:42.228094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:42.228718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:42.235241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:42.235933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:42.236709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:42.237138 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:42.370357 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:42.378783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e500d8e9-63bb-44c2-864b-6a3e5633425c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.154601 May 26 21:56:42.379351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1536/3049] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:42 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:42.503962 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:42.504608 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:42.511096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:42.511544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:42.512341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:42.512818 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:42.650268 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:42.651624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-3e0739e0-c77c-4955-80bf-3af12b4bc991 req-8ed3e78d-6b5e-4824-9171-b3c397de8e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e664bb-6461-4713-998e-cc5d075d4458", "name": "network-vif-plugged", "status": "completed", "tag": "d8070021-a36a-4b6e-935a-a6d79c5384de"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:42.658524 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e5469963-7de7-4403-8c72-91e7a144c2ea tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.158725 May 26 21:56:42.659238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3e0739e0-c77c-4955-80bf-3af12b4bc991 req-8ed3e78d-6b5e-4824-9171-b3c397de8e91 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:42.659692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-3e0739e0-c77c-4955-80bf-3af12b4bc991 req-8ed3e78d-6b5e-4824-9171-b3c397de8e91 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:42.665114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1514/3050] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:42 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:42.675684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-3e0739e0-c77c-4955-80bf-3af12b4bc991 req-8ed3e78d-6b5e-4824-9171-b3c397de8e91 service nova] Creating event network-vif-plugged:d8070021-a36a-4b6e-935a-a6d79c5384de for instance 97e664bb-6461-4713-998e-cc5d075d4458 on hv-cinder-82880 May 26 21:56:42.680949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-3e0739e0-c77c-4955-80bf-3af12b4bc991 req-8ed3e78d-6b5e-4824-9171-b3c397de8e91 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095817 May 26 21:56:42.681545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1537/3051] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:56:43.395438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:43.396062 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:43.397955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:43.398632 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=12 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:43.399293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:43.403996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:43.404448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:43.405241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:43.405682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:43.537528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:43.544869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-13454d50-e393-4e22-8441-6fa50161b42d tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.153280 May 26 21:56:43.545442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1515/3052] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:43 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:43.673095 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=12 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:56:43.677659 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:43.678366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:43.684612 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:43.685074 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:43.685839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:43.686278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:43.818820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:43.826362 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c54beedc-e1da-45b9-9dd8-5035dc657429 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.154938 May 26 21:56:43.826941 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1538/3053] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:43 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:44.562964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:44.563583 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:44.572760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:44.572760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:44.572760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:44.572760 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:44.697495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-40b3ddfc-b159-4424-9b91-26728fd8e0e1 req-c13d9df6-d610-4de8-b3c3-f9027ec8c87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca496d3c-baab-45a8-a23c-f88eec4d16d3", "name": "network-vif-plugged", "status": "completed", "tag": "b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:44.703087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:44.706695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40b3ddfc-b159-4424-9b91-26728fd8e0e1 req-c13d9df6-d610-4de8-b3c3-f9027ec8c87a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:44.707141 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-40b3ddfc-b159-4424-9b91-26728fd8e0e1 req-c13d9df6-d610-4de8-b3c3-f9027ec8c87a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:44.711088 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cddbab95-9643-496c-9f4e-fa3a525ec9ff tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1363 microversion: 2.1 time: 0.152480 May 26 21:56:44.711661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1516/3054] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:44 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:44.718154 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-40b3ddfc-b159-4424-9b91-26728fd8e0e1 req-c13d9df6-d610-4de8-b3c3-f9027ec8c87a service nova] Creating event network-vif-plugged:b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee for instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 on hv-cinder-82880 May 26 21:56:44.723874 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-40b3ddfc-b159-4424-9b91-26728fd8e0e1 req-c13d9df6-d610-4de8-b3c3-f9027ec8c87a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030306 May 26 21:56:44.724501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1539/3055] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:56:44.843460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:44.844684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:44.850627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:44.851085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:44.851844 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:44.852292 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:44.985589 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:44.993200 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5321ac80-27ec-4bdd-a748-ac2752b84dde tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.153687 May 26 21:56:44.993766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1517/3056] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:44 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:56:45.729435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:45.730143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:45.737307 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:45.737762 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:45.738523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:45.738965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:45.868847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:45.876317 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-05f8241d-be54-4c36-8c36-bde1b3436550 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1549 microversion: 2.1 time: 0.151616 May 26 21:56:45.876918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1540/3057] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:45 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:45.892569 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:45.893099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:45.899640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:45.900180 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:45.900979 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:45.901421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:45.976533 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6aa3a7c0-dedd-4aa9-8239-635b73f9d576 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088089 May 26 21:56:45.977157 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1518/3058] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:56:45 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:56:46.010109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:46.010737 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:46.016851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:46.017310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:46.018075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:46.018523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:46.258262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:46.265791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f15ec5da-dc9a-4890-bb34-8e21fff3d4b3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1366 microversion: 2.1 time: 0.259565 May 26 21:56:46.266466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1541/3059] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:46 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:47.015219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-089db932-727f-4860-9dc5-4289bbaac54a req-c0950c93-c712-4274-8204-d912322ffa1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97e664bb-6461-4713-998e-cc5d075d4458", "tag": "d8070021-a36a-4b6e-935a-a6d79c5384de"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:47.031054 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-089db932-727f-4860-9dc5-4289bbaac54a req-c0950c93-c712-4274-8204-d912322ffa1a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:47.031563 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-089db932-727f-4860-9dc5-4289bbaac54a req-c0950c93-c712-4274-8204-d912322ffa1a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:47.044021 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-089db932-727f-4860-9dc5-4289bbaac54a req-c0950c93-c712-4274-8204-d912322ffa1a service nova] Creating event network-changed:d8070021-a36a-4b6e-935a-a6d79c5384de for instance 97e664bb-6461-4713-998e-cc5d075d4458 on hv-cinder-82880 May 26 21:56:47.049203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-089db932-727f-4860-9dc5-4289bbaac54a req-c0950c93-c712-4274-8204-d912322ffa1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038388 May 26 21:56:47.050375 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1519/3060] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:56:47.283375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:47.283994 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:47.291233 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:47.291698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:47.292471 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:47.292933 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:47.435418 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:56:47.443046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6139e134-7cf8-4bd4-ab6b-fe681a2833e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1555 microversion: 2.1 time: 0.164593 May 26 21:56:47.443626 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1542/3061] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:56:47 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:56:47.459824 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:56:47.460495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:56:47.467061 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:47.467582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:47.471358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:47.471358 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:47.550644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-5e211e46-1523-47d4-b3f0-041460acc4ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094897 May 26 21:56:47.551310 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1520/3062] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:56:47 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:56:49.065246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-d6a6b68b-4c6f-4fef-9202-426c57e3b189 req-a6eacc7a-08fd-4029-aa92-2c4c5094582d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca496d3c-baab-45a8-a23c-f88eec4d16d3", "tag": "b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:56:49.073719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-d6a6b68b-4c6f-4fef-9202-426c57e3b189 req-a6eacc7a-08fd-4029-aa92-2c4c5094582d service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:56:49.074169 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-d6a6b68b-4c6f-4fef-9202-426c57e3b189 req-a6eacc7a-08fd-4029-aa92-2c4c5094582d service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:56:49.085060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-d6a6b68b-4c6f-4fef-9202-426c57e3b189 req-a6eacc7a-08fd-4029-aa92-2c4c5094582d service nova] Creating event network-changed:b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee for instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 on hv-cinder-82880 May 26 21:56:49.090241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-d6a6b68b-4c6f-4fef-9202-426c57e3b189 req-a6eacc7a-08fd-4029-aa92-2c4c5094582d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029520 May 26 21:56:49.090835 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1543/3063] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:02.305132 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=11 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:02.305921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=47 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:02.310278 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:02.314642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:02.317406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:02.317856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:02.318616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:02.319056 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:02.341953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9fbdd2b4-9fdd-4fdc-b3c8-eea8827f57a9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/ips" status: 200 len: 146 microversion: 2.1 time: 0.039010 May 26 21:58:02.343038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1521/3064] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:58:02 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:03.864790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=27 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:03.865873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=92 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:03.870268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:03.870985 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:03.877059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:03.879610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:03.879610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:03.879610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:03.906024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d685ce43-f413-48a3-b074-10b4ccd002c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/ips" status: 200 len: 149 microversion: 2.1 time: 0.043531 May 26 21:58:03.906603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1544/3065] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 21:58:03 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:05.570873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:05.570873 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:05.577457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:05.578130 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:05.579150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:05.579585 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:05.595150 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 HTTP/1.1 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:58:05.596937 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.598750 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '40e09a92-16a3-42f4-8961-6cb2a1decba3'} May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:05.600256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.602415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:05.604385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:05.604385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-a2ce8c53-2ff2-4ac8-9178-31bcdd57c8a8 tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 404 len: 111 microversion: 2.20 time: 0.038860 May 26 21:58:05.604385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1522/3066] 10.222.0.66 () {60 vars in 1279 bytes} [Thu May 26 21:58:05 2022] DELETE /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 26 21:58:05.607283 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:05.607949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] [instance: 40e09a92-16a3-42f4-8961-6cb2a1decba3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:05.617909 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:05.620893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:05.620893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:05.620893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:05.635077 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] HTTP exception thrown: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Request method failure captured: May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 HTTP/1.1 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9MiiLZoFEN2fvlUsBXR7z_cEGC5PpXdo5trkF8CmXc5WG0DvfIbr_1N8WZP10YqLQkN0cAPM0zBNL7-w-u6ZiNMV1fnvXQ7rGjuS0q4jv30mBpF6VoJI5BW-imuS3dIWJ04dkYsWyeYM6VfHcxPNMKiPIzPYcRSW-1E_vYzTC5wlg May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Openstack-Nova-Api-Version: 2.20 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:58:05.636785 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/28874954ef9f45c78ad761ed4a1719cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 28874954ef9f45c78ad761ed4a1719cb May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-917014603 May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 7d524a8208354c2099eb3b41b0f53de2 May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeShelveTestJSON-917014603-project May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.638275 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '40e09a92-16a3-42f4-8961-6cb2a1decba3'} May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:05.638965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. May 26 21:58:05.639991 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:05.640980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] Returning 404 to user: Instance 40e09a92-16a3-42f4-8961-6cb2a1decba3 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:05.640980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0214208c-4c84-4a16-8191-b869491a08cd tempest-AttachVolumeShelveTestJSON-917014603 tempest-AttachVolumeShelveTestJSON-917014603-project] 10.222.0.66 "GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3" status: 404 len: 111 microversion: 2.20 time: 0.034994 May 26 21:58:05.640980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1545/3067] 10.222.0.66 () {60 vars in 1276 bytes} [Thu May 26 21:58:05 2022] GET /compute/v2.1/servers/40e09a92-16a3-42f4-8961-6cb2a1decba3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 26 21:58:06.540205 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "014c7654-bde5-4745-9637-a21997d1cc54"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:06.541311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:06.547660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:06.548122 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:06.548928 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:06.549374 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:07.344646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-69d47b7e-3223-421a-b37a-c2967264525e req-056593c8-1e55-4a09-9f8e-9fdd57a7a192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a593d7f5-c378-4a24-a59d-53fcf2e6ffcc", "name": "network-vif-deleted", "tag": "2c2d13db-51bd-48b0-b8f7-bb7290971377"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:07.359904 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-69d47b7e-3223-421a-b37a-c2967264525e req-056593c8-1e55-4a09-9f8e-9fdd57a7a192 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:07.360685 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-69d47b7e-3223-421a-b37a-c2967264525e req-056593c8-1e55-4a09-9f8e-9fdd57a7a192 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:07.374128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-69d47b7e-3223-421a-b37a-c2967264525e req-056593c8-1e55-4a09-9f8e-9fdd57a7a192 service nova] Creating event network-vif-deleted:2c2d13db-51bd-48b0-b8f7-bb7290971377 for instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc on hv-cinder-82880 May 26 21:58:07.380310 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-69d47b7e-3223-421a-b37a-c2967264525e req-056593c8-1e55-4a09-9f8e-9fdd57a7a192 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047336 May 26 21:58:07.381607 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1546/3068] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:07.730321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6e38b980-09d3-449f-bb02-bf5a3bc20d64 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.193962 May 26 21:58:07.735851 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef4b148-ff6d-4acb-84df-187f09f3b73a"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:07.737118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:07.741671 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1523/3069] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:58:06 2022] POST /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 194 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:07.744768 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:07.745234 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:07.746017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:07.746519 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:08.855318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c28cea13-775d-495d-911c-b8971c159aaa tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124442 May 26 21:58:08.855949 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1547/3070] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:58:07 2022] POST /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:09.397929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-2f0b937c-be6f-4fb3-9b0f-6bdd24d7c643 req-9bb67706-f904-438f-a778-9674c9a48a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6ec354-4f9e-406a-80a5-90856a7fead8", "name": "network-vif-deleted", "tag": "241fdbd4-c846-46aa-a9a2-27a629464f87"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:09.406651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f0b937c-be6f-4fb3-9b0f-6bdd24d7c643 req-9bb67706-f904-438f-a778-9674c9a48a97 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:09.407171 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-2f0b937c-be6f-4fb3-9b0f-6bdd24d7c643 req-9bb67706-f904-438f-a778-9674c9a48a97 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:09.418424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-2f0b937c-be6f-4fb3-9b0f-6bdd24d7c643 req-9bb67706-f904-438f-a778-9674c9a48a97 service nova] Creating event network-vif-deleted:241fdbd4-c846-46aa-a9a2-27a629464f87 for instance 0e6ec354-4f9e-406a-80a5-90856a7fead8 on hv-cinder-82880 May 26 21:58:09.423938 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-2f0b937c-be6f-4fb3-9b0f-6bdd24d7c643 req-9bb67706-f904-438f-a778-9674c9a48a97 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030517 May 26 21:58:09.424473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1524/3071] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:22.014198 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=8 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.015044 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.019875 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:22.020992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:22.027282 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:22.031368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:22.031368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:22.031368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:22.063943 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-53eb9b68-d648-42d9-ad13-d5888608c7de tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051330 May 26 21:58:22.064522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1548/3072] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:22 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:22.072184 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=8 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.072901 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:22.077596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:22.079893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:22.084971 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:22.085425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:22.086216 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:22.086631 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:22.115641 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-26bc3a8a-70f9-4b98-a2cd-ce49b7cfc74a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54" status: 200 len: 194 microversion: 2.1 time: 0.044904 May 26 21:58:22.116677 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1525/3073] 10.222.0.66 () {58 vars in 1412 bytes} [Thu May 26 21:58:22 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:23.671199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e7e4cd9-3774-49b9-b2b5-3ba9f3ca0293"}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:23.672857 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:23.679633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:23.680218 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:23.681021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:23.681453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:24.559939 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-df6f8335-4f9e-4507-8a04-020f5c7c398b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "POST /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.892773 May 26 21:58:24.560336 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1549/3074] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:58:23 2022] POST /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 194 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:29.220264 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ef4b148-ff6d-4acb-84df-187f09f3b73a"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:29.221576 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:29.229135 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.229772 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.230675 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.231141 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.316830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: POST /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments HTTP/1.1 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 74 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:58:29.318545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {"volumeAttachment": {"volumeId": "7ef4b148-ff6d-4acb-84df-187f09f3b73a"}} May 26 21:58:29.319964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'server_id': 'ca496d3c-baab-45a8-a23c-f88eec4d16d3', 'body': {'volumeAttachment': {'volumeId': '7ef4b148-ff6d-4acb-84df-187f09f3b73a'}}} May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:29.320759 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:29.321940 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 400 to user: Invalid volume: volume 7ef4b148-ff6d-4acb-84df-187f09f3b73a is already attached to instances: ca496d3c-baab-45a8-a23c-f88eec4d16d3 {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7768017e-1019-442d-a27d-9132c6044ec2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104364 May 26 21:58:29.323156 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1526/3075] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 21:58:29 2022] POST /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 26 21:58:29.380932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:29.381511 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:29.390953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.394115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.394115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.394115 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.521702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid ca496d3c-baab-45a8-a23c-f88eec4d16d3 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:58:29.809394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3778d535-7d49-458f-87be-d42cece9e5dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments/7ef4b148-ff6d-4acb-84df-187f09f3b73a" status: 202 len: 0 microversion: 2.1 time: 0.418421 May 26 21:58:29.809394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1550/3076] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:58:29 2022] DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments/7ef4b148-ff6d-4acb-84df-187f09f3b73a => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:58:29.817424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:29.818513 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:29.825954 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.826412 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.827194 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:29.827686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:29.857866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-13cf4c4f-8a61-4e82-ab72-7b1ffae02dc8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046922 May 26 21:58:29.858426 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1527/3077] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:29 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:30.870849 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:30.871864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:30.878702 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:30.879187 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:30.879948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:30.880383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:30.909538 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0e6722b1-7223-4139-a795-0987ba779f7e tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 May 26 21:58:30.910100 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1551/3078] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:30 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:31.921316 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:31.922785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:31.929916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:31.930373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:31.931212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:31.931653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:31.961072 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6c549e15-6604-4e8f-8ff9-0d266e5b76e7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043872 May 26 21:58:31.961656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1528/3079] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:31 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:32.972464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:32.973411 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:32.980109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:32.980552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:32.981351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:32.981782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:33.010295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-074efc53-f767-4faf-9560-8af77c7c36e6 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042316 May 26 21:58:33.010847 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1552/3080] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:32 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:34.021931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:34.023022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:34.029955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:34.029955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:34.030715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:34.031147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:34.063076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c7079e0-a43a-479a-9969-5096e5f65fb5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045040 May 26 21:58:34.063640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1529/3081] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:34 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:35.074644 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:35.075574 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:35.084313 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:35.084966 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:35.086024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:35.086610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:35.118565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-04e7d9d0-032f-4e6d-b2a1-053e6942d8dd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047828 May 26 21:58:35.119130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1553/3082] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:35 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:36.131027 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:36.131964 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:36.140346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.140346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.146057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.146057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.170098 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-203c6a73-df06-4714-ad8e-6ccce4dbeebb tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043330 May 26 21:58:36.170674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1530/3083] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:36 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:36.331950 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:36.332984 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:36.339564 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.357400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.357400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.357400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.373365 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-19cb6f4c-7088-46d7-9b90-22707d56701a tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045926 May 26 21:58:36.374525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1554/3084] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:36 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:36.512789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:36.514832 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:36.519682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.520134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.520929 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.521371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.549789 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2b79af74-3fda-45aa-892a-b46c1a2ec43c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54" status: 200 len: 194 microversion: 2.1 time: 0.041092 May 26 21:58:36.550395 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1531/3085] 10.222.0.66 () {58 vars in 1412 bytes} [Thu May 26 21:58:36 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:36.560199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:36.560718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:36.567354 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.567801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.568549 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:36.569000 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:36.648855 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 97e664bb-6461-4713-998e-cc5d075d4458 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:58:36.847997 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-73d89eeb-b486-474a-97f9-c0321fd303d6 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54" status: 202 len: 0 microversion: 2.1 time: 0.291540 May 26 21:58:36.848927 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1555/3086] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:58:36 2022] DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/014c7654-bde5-4745-9637-a21997d1cc54 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:58:37.182340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:37.183281 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:37.190668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.191124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.191980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.192506 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.223387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c825efd7-ca2a-44f9-a80d-3b1d4e285f23 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045045 May 26 21:58:37.224041 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1532/3087] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:37 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:58:37.284175 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:37.284906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:37.292699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.293145 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.294040 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.294545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.323429 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:58:37.668295 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c5a94b0e-70bf-4605-8abd-c2526c0e0f33 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 204 len: 0 microversion: 2.1 time: 0.388045 May 26 21:58:37.669539 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1556/3088] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:58:37 2022] DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:58:37.677667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:37.678346 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:37.684385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.684868 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.685659 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:37.686058 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:37.822490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:37.830440 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6f22ad6a-8447-4d2e-9202-230496823024 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1680 microversion: 2.1 time: 0.156705 May 26 21:58:37.831014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1533/3089] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:37 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:58:38.848992 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:38.849698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:38.856967 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:38.857475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:38.858185 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:38.858623 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:39.007697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:39.017443 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bce14267-0c7e-41e8-8d4e-c96ff1afe11c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1680 microversion: 2.1 time: 0.173097 May 26 21:58:39.018130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1557/3090] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:38 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:40.035038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:40.035653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:40.046024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.046555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.047552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.048175 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.119618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:40.120189 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:40.126873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.127267 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.128067 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.128925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.160916 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-17319281-4bea-4d66-b7c3-8b70b2e0f24c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/7e7e4cd9-3774-49b9-b2b5-3ba9f3ca0293" status: 200 len: 194 microversion: 2.1 time: 0.045534 May 26 21:58:40.161525 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1558/3091] 10.222.0.66 () {58 vars in 1412 bytes} [Thu May 26 21:58:40 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/7e7e4cd9-3774-49b9-b2b5-3ba9f3ca0293 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:58:40.179184 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:40.180094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:40.186693 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.194791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.194791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.194791 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.203627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:40.212331 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-141409ae-a9d7-4c0b-9b51-fb905b39a6c8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1680 microversion: 2.1 time: 0.181944 May 26 21:58:40.213096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1534/3092] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:40 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:40.277251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'services' on Instance uuid 97e664bb-6461-4713-998e-cc5d075d4458 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:58:40.280683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:40.521712 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5052dbe3-c6bc-4929-a2aa-8b444f46d3f9 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/7e7e4cd9-3774-49b9-b2b5-3ba9f3ca0293" status: 202 len: 0 microversion: 2.1 time: 0.347473 May 26 21:58:40.522311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1559/3093] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 21:58:40 2022] DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments/7e7e4cd9-3774-49b9-b2b5-3ba9f3ca0293 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:58:40.885421 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-dde77100-990c-4f71-9eb4-2db1430084b5 req-df565318-845d-4e8f-90d2-27c2490d6602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca496d3c-baab-45a8-a23c-f88eec4d16d3", "name": "network-vif-deleted", "tag": "b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:40.894179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-dde77100-990c-4f71-9eb4-2db1430084b5 req-df565318-845d-4e8f-90d2-27c2490d6602 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:40.894618 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-dde77100-990c-4f71-9eb4-2db1430084b5 req-df565318-845d-4e8f-90d2-27c2490d6602 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:40.905843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-dde77100-990c-4f71-9eb4-2db1430084b5 req-df565318-845d-4e8f-90d2-27c2490d6602 service nova] Creating event network-vif-deleted:b90db0a2-f3fb-461e-8b6f-a0dc7a15f5ee for instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 on hv-cinder-82880 May 26 21:58:40.910930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-dde77100-990c-4f71-9eb4-2db1430084b5 req-df565318-845d-4e8f-90d2-27c2490d6602 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029607 May 26 21:58:40.911555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1535/3094] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:41.231058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:41.231758 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:41.238842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.239294 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.240051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.240487 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.272673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.273127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.273580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'fault' on Instance uuid ca496d3c-baab-45a8-a23c-f88eec4d16d3 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:58:41.315579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:41.323120 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a21aada7-3ac5-4684-b125-28e2c9403bd7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 200 len: 1330 microversion: 2.1 time: 0.096885 May 26 21:58:41.328641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1560/3095] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:41 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:41.585159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-944066046", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:41.654053 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] validate_networks() for None {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:58:41.709680 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:41.710928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:41.719434 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.720367 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.722382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.723179 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.757496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d21bfab7-2a65-4874-ba73-abca43a4f9dd tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052116 May 26 21:58:41.758380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1561/3096] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:41 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:58:41.908894 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:41.909924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:41.918130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.918624 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.919428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:41.920048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:41.950656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0dd87002-39d6-4013-b781-6de1cb67d482 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060081 May 26 21:58:41.951580 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1562/3097] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 21:58:41 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 21:58:42.019866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:58:42.019866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:58:42.019866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:58:42.019866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:58:42.019866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:58:42.033910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:42.034615 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:42.037696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.038265 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.039182 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.039728 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.041809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.042638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.043761 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.044356 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.061710 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Getting quotas for project 8332bce1e1414c2f84ba8de65b29b198. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:58:42.069413 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Getting quotas for user ad78c9dc73a149c19e66e147dd9cbeed and project 8332bce1e1414c2f84ba8de65b29b198. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:58:42.074372 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:58:42.086592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:58:42.089351 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:58:42.256210 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7fb113cf-461c-4020-9353-f1560dab51a9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676876 May 26 21:58:42.256889 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1536/3098] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:58:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 26 21:58:42.266849 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f174e50b-86f3-4ad5-80f8-4c7f9050b5f0 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:42.268138 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f174e50b-86f3-4ad5-80f8-4c7f9050b5f0 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:42.329610 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f174e50b-86f3-4ad5-80f8-4c7f9050b5f0 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:42.338388 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f174e50b-86f3-4ad5-80f8-4c7f9050b5f0 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1214 microversion: 2.1 time: 0.075149 May 26 21:58:42.339211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1537/3099] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:42 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:42.344826 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:42.346473 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:42.353215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.353678 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.354828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.355274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.373241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 HTTP/1.1 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:58:42.375619 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 21:58:42.383471 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'ca496d3c-baab-45a8-a23c-f88eec4d16d3'} May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:42.384953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 21:58:42.386254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:42.387460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:42.387460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-999712a5-7bcc-4711-9d10-f53320f4c6e5 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 404 len: 111 microversion: 2.1 time: 0.037600 May 26 21:58:42.388118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1538/3100] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:42 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:58:42.393785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-08e8ad4d-b65f-4413-8063-b6d2617261b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '.version_select at 0x7f46c8305310>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:42.397460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [None req-08e8ad4d-b65f-4413-8063-b6d2617261b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [7d2880c4-b178-4014-8f6d-b827bee0e4f2] AMQP server on 10.222.0.66:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 26 21:58:42.567920 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bafebbc3-e5c5-4e5c-a299-5a35a74f7b0c tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 204 len: 0 microversion: 2.1 time: 0.537818 May 26 21:58:42.568496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1563/3101] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:58:42 2022] DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:58:42.578022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:42.581682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:42.585261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.585716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.586484 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:42.586923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:42.720945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:42.729122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a185830c-754b-4bd5-93b3-30683d5f1d94 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1674 microversion: 2.1 time: 0.155831 May 26 21:58:42.729690 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1564/3102] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:42 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:58:43.355454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f98b268-0a21-46ff-8518-4d498ffbab9b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:43.356093 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f98b268-0a21-46ff-8518-4d498ffbab9b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:43.404465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [None req-08e8ad4d-b65f-4413-8063-b6d2617261b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [7d2880c4-b178-4014-8f6d-b827bee0e4f2] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 53170. May 26 21:58:43.412407 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0f98b268-0a21-46ff-8518-4d498ffbab9b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:43.419826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f98b268-0a21-46ff-8518-4d498ffbab9b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1214 microversion: 2.1 time: 0.068290 May 26 21:58:43.420435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1565/3103] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:43 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:43.563516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-08e8ad4d-b65f-4413-8063-b6d2617261b7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-871438041" status: 202 len: 0 microversion: 2.1 time: 1.174191 May 26 21:58:43.564095 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1539/3104] 10.222.0.66 () {58 vars in 1217 bytes} [Thu May 26 21:58:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-871438041 => generated 0 bytes in 1175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:58:43.747279 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:43.747898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:43.755009 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:43.755462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:43.756221 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:43.756698 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:43.910478 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:43.918241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-45834448-5ed6-4dac-ba60-a49cc173203f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1674 microversion: 2.1 time: 0.174773 May 26 21:58:43.918801 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1566/3105] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:43 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:44.437230 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:44.437895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:44.444930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:44.450864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:44.450864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:44.450864 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:44.508989 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:44.517434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-fd2508c7-e9c7-4782-8f5f-ec7e5393b883 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1210 microversion: 2.1 time: 0.084574 May 26 21:58:44.519609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1540/3106] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:44 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:44.590058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e90059b0-9ff9-437e-9944-b7104eab82a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: .version_select at 0x7f46c8193d30>, body: {"keypair": {"name": "tempest-keypair-527518826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7vdQOhViwPoygITNYVFEi8aLrNag9o+GPSUWzDt4mptsgC8s+Rpi/5UaLsMdrbzGJtwNEWarMnWwdC+OIPglvVbPmvMDZFIWdZRF1xRbMNdbdrh4Hprqo7K0gcXmkSLQ=="}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:44.606043 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-e90059b0-9ff9-437e-9944-b7104eab82a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:58:44.610002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-e90059b0-9ff9-437e-9944-b7104eab82a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'key_pairs'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:58:44.709679 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e90059b0-9ff9-437e-9944-b7104eab82a2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123469 May 26 21:58:44.710291 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1567/3107] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 21:58:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:44.936012 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:44.936669 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:44.942932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:44.943489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:44.944147 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:44.944613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:45.096114 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:45.102126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cabbe37c-bd89-4f59-90bc-8643bcb0aaf7 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1674 microversion: 2.1 time: 0.169996 May 26 21:58:45.108869 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1541/3108] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:44 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:45.534646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:45.535380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:45.541784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:45.542419 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:45.547661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:45.547661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:45.628072 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:45.635650 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1d2614f1-2d58-4d6e-bb07-1bedcb16835f tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1284 microversion: 2.1 time: 0.105535 May 26 21:58:45.636226 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1568/3109] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:45 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:46.045705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-9e940220-f18d-4445-aa25-316d061bba24 req-c56e908a-3c7f-40da-bc85-85081aa89c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97e664bb-6461-4713-998e-cc5d075d4458", "name": "network-vif-deleted", "tag": "d8070021-a36a-4b6e-935a-a6d79c5384de"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:46.059476 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-9e940220-f18d-4445-aa25-316d061bba24 req-c56e908a-3c7f-40da-bc85-85081aa89c0a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:46.060244 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-9e940220-f18d-4445-aa25-316d061bba24 req-c56e908a-3c7f-40da-bc85-85081aa89c0a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:46.082922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-9e940220-f18d-4445-aa25-316d061bba24 req-c56e908a-3c7f-40da-bc85-85081aa89c0a service nova] Creating event network-vif-deleted:d8070021-a36a-4b6e-935a-a6d79c5384de for instance 97e664bb-6461-4713-998e-cc5d075d4458 on hv-cinder-82880 May 26 21:58:46.088754 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-9e940220-f18d-4445-aa25-316d061bba24 req-c56e908a-3c7f-40da-bc85-85081aa89c0a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051022 May 26 21:58:46.089552 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1542/3110] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:46.119586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:46.120129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:46.127792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:46.128167 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:46.128981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:46.129426 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:46.210631 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:46.219223 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9d800562-de4f-448e-858d-ccc95da724d4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1606 microversion: 2.1 time: 0.103640 May 26 21:58:46.219820 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1569/3111] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:46 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:58:46.653674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:46.654306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:46.661286 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:46.661742 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:46.662509 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:46.662952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:46.915514 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:46.926066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-332cf0e3-8f17-4731-af27-a94019fad053 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.276549 May 26 21:58:46.927226 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1543/3112] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:46 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:47.237250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:47.238001 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:47.245004 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.245459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:47.246228 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.246669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:47.283803 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.284278 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:47.284748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lazy-loading 'fault' on Instance uuid 97e664bb-6461-4713-998e-cc5d075d4458 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:58:47.326416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '388330e61ade4f188c40c11c4ac46fd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e24cfce792042e2b665ef2cca91b752', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:47.335465 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d5c44688-429b-4f39-8000-8602a2152b2f tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 200 len: 1327 microversion: 2.1 time: 0.102462 May 26 21:58:47.336036 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1570/3113] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:47 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 1327 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:47.662633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2111846216", "imageRef": "b5109fff-9613-43c9-b15b-789ff0731cff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e07a43e-b6dc-4850-bc07-d904a80346a4"}], "security_groups": [{"name": "tempest-securitygroup--981280229"}], "key_name": "tempest-keypair-527518826", "user_data": "}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:47.815570 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.network.neutron [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] validate_networks() for [('4e07a43e-b6dc-4850-bc07-d904a80346a4', None, None, None, None, None)] {{(pid=118354) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 21:58:47.951249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-4f896f3b-239c-4483-8574-2f5cc880ea06 req-6d42e03c-6e1b-4b19-9238-52e2a5bf72d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7db4f96e-f9e4-4513-8bdd-1a8dd32b3032", "tag": "d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:47.959908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-4f896f3b-239c-4483-8574-2f5cc880ea06 req-6d42e03c-6e1b-4b19-9238-52e2a5bf72d5 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.961903 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-4f896f3b-239c-4483-8574-2f5cc880ea06 req-6d42e03c-6e1b-4b19-9238-52e2a5bf72d5 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:47.972330 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-4f896f3b-239c-4483-8574-2f5cc880ea06 req-6d42e03c-6e1b-4b19-9238-52e2a5bf72d5 service nova] Creating event network-changed:d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec for instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 on hv-cinder-82880 May 26 21:58:47.977263 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-4f896f3b-239c-4483-8574-2f5cc880ea06 req-6d42e03c-6e1b-4b19-9238-52e2a5bf72d5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212294 May 26 21:58:47.977882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1571/3114] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:47.983164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:47.983859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:47.990666 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.991122 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:47.991886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:47.992598 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:48.333575 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:48.341061 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f884153c-8d40-4740-8771-bcd0a150f3e8 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.361788 May 26 21:58:48.341637 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1572/3115] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:47 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:48.352265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:48.352872 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:48.358953 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:48.359410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:48.360182 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:48.360646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:48.374944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 HTTP/1.1 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:58:48.377701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:48.379023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '97e664bb-6461-4713-998e-cc5d075d4458'} May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:48.379815 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:48.381101 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:48.382208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 404 to user: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:48.382208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c191b9bb-5380-4559-aff7-dd3c78a7f5f4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 404 len: 111 microversion: 2.1 time: 0.029769 May 26 21:58:48.382208 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1573/3116] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:48 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 21:58:48.386906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d5ce2e57-9e29-425c-9d8f-83f822c75ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '.version_select at 0x7f46c836eaf0>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:48.466498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d5ce2e57-9e29-425c-9d8f-83f822c75ffe tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546269191" status: 202 len: 0 microversion: 2.1 time: 0.083181 May 26 21:58:48.467222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1574/3117] 10.222.0.66 () {58 vars in 1220 bytes} [Thu May 26 21:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1546269191 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 21:58:48.523109 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 21:58:48.524249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image limits 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 21:58:48.524785 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Flavor pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 21:58:48.525485 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Image pref 0:0:0 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 21:58:48.526723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.virt.hardware [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118354) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 21:58:48.541984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:48.542645 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:48.543651 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:48.544094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:48.565277 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 21:58:48.570123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Getting quotas for user 46e692bef3e3484ebac5d1563e489e03 and project 4f08b4e75498402eb658938f61de1244. Resources: {'ram', 'instances', 'cores'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 21:58:48.587900 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Going to run 1 instances... {{(pid=118354) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 21:58:48.591081 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5109fff-9613-43c9-b15b-789ff0731cff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118354) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 21:58:48.738523 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ef12344d-9319-4ee9-a7b6-ecad8bd6e15c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.080117 May 26 21:58:48.745587 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1544/3118] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 21:58:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 21:58:48.750829 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1982bc1c-2d19-4f3e-ba3c-f3e74ab461ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:48.751996 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1982bc1c-2d19-4f3e-ba3c-f3e74ab461ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:49.099935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-1982bc1c-2d19-4f3e-ba3c-f3e74ab461ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:49.099935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1982bc1c-2d19-4f3e-ba3c-f3e74ab461ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1241 microversion: 2.1 time: 0.351002 May 26 21:58:49.099935 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1575/3119] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:48 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1241 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 21:58:49.358767 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:49.359301 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:49.366685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:49.367391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:49.368148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:49.368684 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:49.568748 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:49.576685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-109bc532-9fee-46b9-b824-0d4b736049b2 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.221822 May 26 21:58:49.584624 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1545/3120] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:49 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:50.114787 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e32a9a95-bc17-4ddc-b819-1711cbd44039 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:50.115496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e32a9a95-bc17-4ddc-b819-1711cbd44039 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:50.168862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-e32a9a95-bc17-4ddc-b819-1711cbd44039 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:50.176334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e32a9a95-bc17-4ddc-b819-1711cbd44039 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1241 microversion: 2.1 time: 0.064692 May 26 21:58:50.176334 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1576/3121] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:50 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:50.593467 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:50.594116 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:50.601158 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:50.601616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:50.602384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:50.602828 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:50.741627 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:50.745637 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=100 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:50.750078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7515f9ff-578e-44b7-a56d-a13bc64ef01c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.160499 May 26 21:58:50.750663 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1546/3122] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:50 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:51.192488 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6c229a10-a333-45bc-bf79-5af1d057955d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:51.193301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6c229a10-a333-45bc-bf79-5af1d057955d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:51.265477 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-6c229a10-a333-45bc-bf79-5af1d057955d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:51.272755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6c229a10-a333-45bc-bf79-5af1d057955d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1241 microversion: 2.1 time: 0.084622 May 26 21:58:51.273320 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1577/3123] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:51 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:51.767063 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:51.767682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:51.774736 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:51.775193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:51.775963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:51.776405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:51.905721 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:51.914195 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-eaf7366a-efb2-493f-9ced-c2fa9c40d690 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.150914 May 26 21:58:51.914761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1547/3124] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:51 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:52.150137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:52.150717 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:52.152788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:52.158041 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.158565 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:52.160017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.160517 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:52.174088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 HTTP/1.1 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:58:52.175705 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.177150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '97e664bb-6461-4713-998e-cc5d075d4458'} May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:52.177923 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.179174 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:52.180400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 404 to user: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:52.180400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a4785120-3b73-47ef-94e7-20b7f472eff4 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 404 len: 111 microversion: 2.1 time: 0.030832 May 26 21:58:52.180400 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1578/3125] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:58:52 2022] DELETE /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:58:52.191276 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:52.192007 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 97e664bb-6461-4713-998e-cc5d075d4458] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:52.199636 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.200259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:52.201078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.201512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:52.216511 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 HTTP/1.1 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:58:52.218380 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.220221 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '97e664bb-6461-4713-998e-cc5d075d4458'} May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:52.221112 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. May 26 21:58:52.222972 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:52.224099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 404 to user: Instance 97e664bb-6461-4713-998e-cc5d075d4458 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:52.224099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-48c09e9b-0eea-4f22-833e-4811d048fee3 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458" status: 404 len: 111 microversion: 2.1 time: 0.036229 May 26 21:58:52.224099 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1548/3126] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:52 2022] GET /compute/v2.1/servers/97e664bb-6461-4713-998e-cc5d075d4458 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:58:52.290377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5740e7a1-9e30-499d-bdeb-f2fec754e90d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:52.290989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5740e7a1-9e30-499d-bdeb-f2fec754e90d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:52.342406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-5740e7a1-9e30-499d-bdeb-f2fec754e90d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:52.350058 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5740e7a1-9e30-499d-bdeb-f2fec754e90d tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1241 microversion: 2.1 time: 0.063634 May 26 21:58:52.350647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1579/3127] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:52 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:52.931124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:52.931862 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:52.938465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.947105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:52.947105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:52.947105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.074943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:53.082352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-88d37433-54d5-45fd-b4d2-8e4c13d68f21 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.154979 May 26 21:58:53.082920 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1549/3128] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:52 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:53.366859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:53.367736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:53.375881 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.377467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.377467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.377706 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.437194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:53.445304 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9d9c2b5f-9bd0-4832-abc3-fa09e347d6cd tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1245 microversion: 2.1 time: 0.083041 May 26 21:58:53.445862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1580/3129] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:53 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:53.557958 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:53.558456 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:53.564434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.564930 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.565689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.566128 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.579309 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 HTTP/1.1 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:58:53.580909 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.582274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '3748fe34-6403-4819-a21a-19fd842440b9'} May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:53.583052 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.584465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:58:53.586008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 404 to user: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:53.586008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-32430a86-e8dc-4b2f-93c9-09e851145d6b tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 404 len: 111 microversion: 2.1 time: 0.028267 May 26 21:58:53.586008 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1550/3130] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:58:53 2022] DELETE /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:58:53.590630 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:53.591249 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] [instance: 3748fe34-6403-4819-a21a-19fd842440b9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:53.598178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.598627 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.599383 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:53.599822 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:53.613854 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] HTTP exception thrown: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Request method failure captured: May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 HTTP/1.1 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9R1lUl4rJCY1a3GCJSLlCWGwwcSB8vprp3WZxeI9azIF0RtOuHCNWpIUoAn8phvR-Ce345nonoCDCrVD6I5dVugzJ1_u4V9aNmszvR_9GOmhSH6NgjQXbpMrXi-rI9anfVJRHYYGqRpBxVkCoxmEOTFVQPn6il_j4fNO9_4Vmxyeo May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 21:58:53.615394 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8e24cfce792042e2b665ef2cca91b752"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 8e24cfce792042e2b665ef2cca91b752 May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeTestJSON-48496005 May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 388330e61ade4f188c40c11c4ac46fd0 May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeTestJSON-48496005-project May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.616898 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '3748fe34-6403-4819-a21a-19fd842440b9'} May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:58:53.617863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. May 26 21:58:53.618858 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 21:58:53.619748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] Returning 404 to user: Instance 3748fe34-6403-4819-a21a-19fd842440b9 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:58:53.619748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6459e708-d7bd-4f86-84c5-ca840c6c0527 tempest-AttachVolumeTestJSON-48496005 tempest-AttachVolumeTestJSON-48496005-project] 10.222.0.66 "GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9" status: 404 len: 111 microversion: 2.1 time: 0.029934 May 26 21:58:53.619748 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1581/3131] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:53 2022] GET /compute/v2.1/servers/3748fe34-6403-4819-a21a-19fd842440b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:58:54.101294 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:54.103001 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:54.109411 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:54.109985 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:54.111251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:54.112117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:54.361638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:54.378527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0c8f7341-f43c-4978-ad62-6c1f0718c94c tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.276664 May 26 21:58:54.378527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1551/3132] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:54 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:54.462871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:54.463495 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:54.470068 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:54.470522 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:54.471316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:54.471774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:54.547999 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:54.562873 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f640ac9b-461b-452c-bde8-7cbb5fe28ca3 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1293 microversion: 2.1 time: 0.104339 May 26 21:58:54.563695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1582/3133] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:54 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:54.882291 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-60332b58-7ae6-46ed-8a30-a91ed2346eaf req-7808a04e-2ac2-4247-a8d5-7e37045111cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db4f96e-f9e4-4513-8bdd-1a8dd32b3032", "name": "network-vif-plugged", "status": "completed", "tag": "d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:54.893809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-60332b58-7ae6-46ed-8a30-a91ed2346eaf req-7808a04e-2ac2-4247-a8d5-7e37045111cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:54.894256 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-60332b58-7ae6-46ed-8a30-a91ed2346eaf req-7808a04e-2ac2-4247-a8d5-7e37045111cf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:54.906458 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-60332b58-7ae6-46ed-8a30-a91ed2346eaf req-7808a04e-2ac2-4247-a8d5-7e37045111cf service nova] Creating event network-vif-plugged:d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec for instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 on hv-cinder-82880 May 26 21:58:54.913085 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-60332b58-7ae6-46ed-8a30-a91ed2346eaf req-7808a04e-2ac2-4247-a8d5-7e37045111cf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038149 May 26 21:58:54.913696 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1552/3134] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:58:55.394110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:55.395384 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:55.401500 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:55.402097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:55.402944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:55.403483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:55.422560 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:55.584460 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:55.586355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:55.593951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:55.594492 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:55.595345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:55.595860 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:55.645954 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:55.658529 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b271c49b-7dc7-47b2-b1c1-47625ff11c0b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.268876 May 26 21:58:55.665832 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1583/3135] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:55 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:55.754042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:55.764365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bdfe265a-8446-4c99-8d86-3e6b92f74495 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1299 microversion: 2.1 time: 0.186361 May 26 21:58:55.765582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1553/3136] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:55 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:56.675755 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:56.676381 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:56.683270 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:56.683731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:56.684503 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:56.684979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:56.783181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:56.783805 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:56.792902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:56.793365 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:56.794152 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:56.794783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:56.913952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:56.922899 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-0be72686-a4b5-4a63-9a11-42378e5daef1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1299 microversion: 2.1 time: 0.144035 May 26 21:58:56.931327 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1554/3137] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:56 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:57.097647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:57.106989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3c5c7481-4aba-4a6e-af7d-0b979da8d699 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1314 microversion: 2.1 time: 0.435543 May 26 21:58:57.108358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1584/3138] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:56 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:57.951015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:57.951015 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:57.956809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:57.957491 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:57.958512 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:57.959108 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.130808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:58.132716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:58.142094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:58.142552 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.144098 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:58.144876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.312416 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:58.327013 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-b6350982-d0d3-423d-9f7e-360c477882a7 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.389346 May 26 21:58:58.328249 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1555/3139] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:57 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:58.476112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:58.485046 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a0c2fefe-9519-48f8-93fc-6d7649ab5800 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1464 microversion: 2.1 time: 0.362448 May 26 21:58:58.495353 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1585/3140] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:58 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:58.530415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:58.531153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:58.541846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:58.541846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.541846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:58.541846 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.567942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:58.573018 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 21:58:58.592406 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=14 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:58.658878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-ed2ac25b-0500-4482-be68-8d9148a30dab req-d67407d7-094b-44e7-ac33-437f7976be30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692", "tag": "44cd339a-795e-466e-b2c7-16b1226215ff"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:58:58.670579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ed2ac25b-0500-4482-be68-8d9148a30dab req-d67407d7-094b-44e7-ac33-437f7976be30 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:58.671028 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-ed2ac25b-0500-4482-be68-8d9148a30dab req-d67407d7-094b-44e7-ac33-437f7976be30 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:58.690902 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-ed2ac25b-0500-4482-be68-8d9148a30dab req-d67407d7-094b-44e7-ac33-437f7976be30 service nova] Creating event network-changed:44cd339a-795e-466e-b2c7-16b1226215ff for instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 on hv-cinder-82880 May 26 21:58:58.707491 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-ed2ac25b-0500-4482-be68-8d9148a30dab req-d67407d7-094b-44e7-ac33-437f7976be30 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052392 May 26 21:58:58.723937 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1586/3141] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 26 21:58:58.840341 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:58:58.991584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cf4e4503-8e08-424c-b629-f7f203beb03d tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 204 len: 0 microversion: 2.1 time: 0.465198 May 26 21:58:58.992203 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1556/3142] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 21:58:58 2022] DELETE /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 21:58:59.002501 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:59.003244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:59.010386 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:59.012908 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:59.017745 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:59.018910 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:59.167527 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:59.175841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f2c5aa59-7ccf-4903-ab69-7a8bfe47905b tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1470 microversion: 2.1 time: 0.177895 May 26 21:58:59.176413 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1587/3143] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:58 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1470 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:58:59.345408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:58:59.346038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:58:59.352686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:59.353145 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:59.354674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:58:59.354674 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:58:59.489408 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:58:59.496981 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-c5657889-a7ff-49ed-9dfa-0f78c1e10e49 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.156185 May 26 21:58:59.497550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1557/3144] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:58:59 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:00.193241 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:00.193709 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:00.200162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:00.201219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:00.202489 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:00.203188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:00.399225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:00.407021 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b315a338-91c8-4b9d-b7ea-4247340ab7cf tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1470 microversion: 2.1 time: 0.217828 May 26 21:59:00.407600 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1588/3145] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:00 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:00.515405 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:00.516078 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:00.522932 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:00.523392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:00.524153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:00.524615 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:00.748208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:00.758588 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78f56bd6-a167-4c2b-8e72-a44f3f1b006b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.247955 May 26 21:59:00.769567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1558/3146] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:00 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:01.195968 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-e859f072-360c-4112-839d-fd86da63f3a4 req-1e750bd0-7d8f-4aa2-bf7b-b8d5066bd3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7db4f96e-f9e4-4513-8bdd-1a8dd32b3032", "name": "network-vif-deleted", "tag": "d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:59:01.204701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-e859f072-360c-4112-839d-fd86da63f3a4 req-1e750bd0-7d8f-4aa2-bf7b-b8d5066bd3e1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:01.205369 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-e859f072-360c-4112-839d-fd86da63f3a4 req-1e750bd0-7d8f-4aa2-bf7b-b8d5066bd3e1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:01.217160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-e859f072-360c-4112-839d-fd86da63f3a4 req-1e750bd0-7d8f-4aa2-bf7b-b8d5066bd3e1 service nova] Creating event network-vif-deleted:d063d538-7b6a-4f0f-90ad-8dc6e8ef54ec for instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 on hv-cinder-82880 May 26 21:59:01.222428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-e859f072-360c-4112-839d-fd86da63f3a4 req-1e750bd0-7d8f-4aa2-bf7b-b8d5066bd3e1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030335 May 26 21:59:01.223039 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1589/3147] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:59:01.425729 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:01.426342 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:01.432435 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:01.432934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:01.433699 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:01.434154 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:01.494982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:01.502345 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ed473601-1e9a-4a5a-bc05-92e18180fee7 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1428 microversion: 2.1 time: 0.081298 May 26 21:59:01.503542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1559/3148] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:01 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1428 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:01.777140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:01.777882 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:01.785632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:01.786102 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:01.787057 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:01.787757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:01.931037 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:01.938860 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a39204d3-e142-4878-bbcf-9584fa1d821b tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.167263 May 26 21:59:01.939451 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1590/3149] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:01 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:02.520977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:02.521647 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:02.528233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:02.528727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:02.529490 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:02.529934 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:02.595726 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:02.603921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9838796d-2cc8-4262-99aa-9e643ba91be9 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1428 microversion: 2.1 time: 0.086988 May 26 21:59:02.604482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1560/3150] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:02 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1428 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:02.959569 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:02.960195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:02.962611 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=14 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:02.967448 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:02.975240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:02.975240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:02.975240 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:03.114684 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:03.122296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d2967f2c-9a6a-4655-b5c2-54e216c19bf1 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.167081 May 26 21:59:03.122864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1591/3151] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:02 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:03.622038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:03.622838 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:03.630808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:03.630808 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:03.631682 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:03.632384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:03.666783 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:03.667330 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:03.667817 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lazy-loading 'fault' on Instance uuid 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 21:59:03.719096 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad78c9dc73a149c19e66e147dd9cbeed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8332bce1e1414c2f84ba8de65b29b198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:03.728146 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-84168629-bb57-4b11-b66f-ee8f97e74a99 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 200 len: 1304 microversion: 2.1 time: 0.110451 May 26 21:59:03.728780 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1561/3152] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:03 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:04.139390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:04.140005 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:04.147475 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:04.147924 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:04.148700 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:04.149143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:04.281636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:04.289162 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c2a0af12-5612-476a-b75c-3cd0415ef2c2 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.153637 May 26 21:59:04.289741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1592/3153] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:04 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:04.745921 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:04.751376 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] [instance: 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:04.754181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:04.754834 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:04.755841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:04.756371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:04.770633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] HTTP exception thrown: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Request method failure captured: May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 HTTP/1.1 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij_gPSELK2UhQLbMreK2vAO8I1ASkeyRxCKlVHdKBhr6uM7sgLNEKOgH0z2w9CqNL9T2jis39OATEDTZ5AZ2Hgx9VhL4meOT_AoJVHq92tr3C8fA045-UYiUISNkLvPEldEHRnq_Gb73rxAT1Ik2h-4S7Y6z_9C65exDcWVzqnAlGE_I May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 8332bce1e1414c2f84ba8de65b29b198 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-VolumesNegativeTest-1820556780 May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 21:59:04.772960 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8332bce1e1414c2f84ba8de65b29b198"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8332bce1e1414c2f84ba8de65b29b198"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8332bce1e1414c2f84ba8de65b29b198"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8332bce1e1414c2f84ba8de65b29b198"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-VolumesNegativeTest-1820556780 May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 8332bce1e1414c2f84ba8de65b29b198 May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-VolumesNegativeTest-1820556780 May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-VolumesNegativeTest-1820556780-project May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: ad78c9dc73a149c19e66e147dd9cbeed May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-VolumesNegativeTest-1820556780-project May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. May 26 21:59:04.776448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '7db4f96e-f9e4-4513-8bdd-1a8dd32b3032'} May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 21:59:04.777222 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. May 26 21:59:04.778274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 21:59:04.779204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] Returning 404 to user: Instance 7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 21:59:04.779204 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f833ae43-411d-499a-b4fc-2a09b0f2cbd6 tempest-VolumesNegativeTest-1820556780 tempest-VolumesNegativeTest-1820556780-project] 10.222.0.66 "GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032" status: 404 len: 111 microversion: 2.1 time: 0.033268 May 26 21:59:04.780457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1562/3154] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:04 2022] GET /compute/v2.1/servers/7db4f96e-f9e4-4513-8bdd-1a8dd32b3032 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 21:59:05.306035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:05.306663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:05.316246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:05.318459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:05.321544 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:05.322200 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:05.480506 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:05.487906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ad439a51-319e-43d8-ba46-9a3c7e5b961a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.185772 May 26 21:59:05.488467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1593/3155] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:05 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:06.507398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:06.508686 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:06.515839 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:06.516409 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:06.517410 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:06.518065 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:06.648922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:06.656835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d73678de-3fe8-4738-b448-d57c74f530ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.155097 May 26 21:59:06.657404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1563/3156] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:06 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:06.919395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-2929f31e-320d-48ec-8c62-217a07089e70 req-f3ecaae0-e9ff-4b52-91b3-a521a0ea18c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692", "name": "network-vif-plugged", "status": "completed", "tag": "44cd339a-795e-466e-b2c7-16b1226215ff"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:59:06.928906 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2929f31e-320d-48ec-8c62-217a07089e70 req-f3ecaae0-e9ff-4b52-91b3-a521a0ea18c1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:06.929360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-2929f31e-320d-48ec-8c62-217a07089e70 req-f3ecaae0-e9ff-4b52-91b3-a521a0ea18c1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:06.940518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-2929f31e-320d-48ec-8c62-217a07089e70 req-f3ecaae0-e9ff-4b52-91b3-a521a0ea18c1 service nova] Creating event network-vif-plugged:44cd339a-795e-466e-b2c7-16b1226215ff for instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 on hv-cinder-82880 May 26 21:59:06.945316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-2929f31e-320d-48ec-8c62-217a07089e70 req-f3ecaae0-e9ff-4b52-91b3-a521a0ea18c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029850 May 26 21:59:06.945917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1594/3157] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:59:07.675463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:07.676136 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:07.683931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:07.683931 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:07.684359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:07.685064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:07.690340 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 21:59:07.818425 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:07.825843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-cbf76b94-9868-42c5-9422-9aca945e8d6c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.155484 May 26 21:59:07.826503 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1564/3158] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:07 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:08.843355 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:08.844099 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:08.850708 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:08.851163 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:08.851934 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:08.852464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:09.000160 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:09.009018 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3b6a61a2-fb13-4dc2-835c-7161603fb6a0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1366 microversion: 2.1 time: 0.170373 May 26 21:59:09.009638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1595/3159] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:08 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:10.029219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:10.029837 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:10.037134 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:10.037592 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:10.038343 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:10.038778 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:10.171197 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 21:59:10.179047 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e626e643-1567-4409-969d-da27cb80a6ce tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1556 microversion: 2.1 time: 0.153654 May 26 21:59:10.179616 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1565/3160] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 21:59:10 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 21:59:10.195961 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 21:59:10.196483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 21:59:10.203157 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:10.203604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:10.204352 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:10.204807 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:10.290846 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-1328a44a-ffcd-42da-ac93-834d6801e811 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098682 May 26 21:59:10.293196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1596/3161] 10.222.0.66 () {58 vars in 1274 bytes} [Thu May 26 21:59:10 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:59:11.572295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-1ce2c0f8-1b16-4d61-9058-b470697d8d32 req-11d8b3f9-0cd2-4161-86f4-60cbdb70c73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692", "tag": "44cd339a-795e-466e-b2c7-16b1226215ff"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 21:59:11.580835 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-1ce2c0f8-1b16-4d61-9058-b470697d8d32 req-11d8b3f9-0cd2-4161-86f4-60cbdb70c73e service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 21:59:11.581318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-1ce2c0f8-1b16-4d61-9058-b470697d8d32 req-11d8b3f9-0cd2-4161-86f4-60cbdb70c73e service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 21:59:11.601402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-1ce2c0f8-1b16-4d61-9058-b470697d8d32 req-11d8b3f9-0cd2-4161-86f4-60cbdb70c73e service nova] Creating event network-changed:44cd339a-795e-466e-b2c7-16b1226215ff for instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 on hv-cinder-82880 May 26 21:59:11.607644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-1ce2c0f8-1b16-4d61-9058-b470697d8d32 req-11d8b3f9-0cd2-4161-86f4-60cbdb70c73e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039034 May 26 21:59:11.608355 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1566/3162] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 21:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 21:59:52.504844 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 21:59:52.505467 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 21:59:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:01:00.773918 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [130df3b5-ff87-4f67-8ac8-b3af6a85bbe6] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 26 22:01:00.774586 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=39 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:00.775222 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=66 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:00.779424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:00.779948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:00.785862 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:00.792981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:00.792981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:00.792981 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:00.811393 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-62dcbf3b-9e96-403e-aa48-ffefb2726b95 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/ips" status: 200 len: 148 microversion: 2.1 time: 0.039397 May 26 22:01:00.812066 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1597/3163] 10.222.0.66 () {58 vars in 1247 bytes} [Thu May 26 22:01:00 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:01:02.358973 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:02.359841 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=12 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:01:02.364162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33f65f04-cc88-403c-83e7-49a228e821bb"}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:01:02.365369 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:02.371457 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:02.372822 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:02.373596 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:02.374039 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:03.250370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ee8dbdb0-ca92-40ff-a176-65ce74566acc tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "POST /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.893648 May 26 22:01:03.261174 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1567/3164] 10.222.0.66 () {60 vars in 1322 bytes} [Thu May 26 22:01:02 2022] POST /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments => generated 194 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:01:10.833048 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:10.833606 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:10.841977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:10.843817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:10.843817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:10.843817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:10.859158 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] [130df3b5-ff87-4f67-8ac8-b3af6a85bbe6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 55066. May 26 22:01:10.977518 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'services' on Instance uuid fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 22:01:11.175193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6a5ea3ce-3f16-4091-8ff7-2adf4ff977d8 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments/33f65f04-cc88-403c-83e7-49a228e821bb" status: 202 len: 0 microversion: 2.1 time: 0.346392 May 26 22:01:11.175774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1598/3165] 10.222.0.66 () {58 vars in 1415 bytes} [Thu May 26 22:01:10 2022] DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments/33f65f04-cc88-403c-83e7-49a228e821bb => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 22:01:11.184804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:11.186449 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:11.193290 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:11.193955 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:11.194731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:11.195173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:11.226042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ed6c1a14-279b-4ae8-adf6-21830c12a147 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045650 May 26 22:01:11.226614 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1568/3166] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 22:01:11 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:01:12.238531 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:12.239585 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:12.245798 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.246243 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.247246 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.247683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.275965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-5131352c-fe62-4a69-ab73-78c1ab21ed3a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042220 May 26 22:01:12.276499 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1599/3167] 10.222.0.66 () {58 vars in 1301 bytes} [Thu May 26 22:01:12 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 26 22:01:12.333762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:12.334259 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:12.341066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.341526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.342295 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.342735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.367465 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Going to try to terminate instance {{(pid=118354) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 22:01:12.618069 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6f7c1cae-1e02-445a-9da7-5f60314734af tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 204 len: 0 microversion: 2.1 time: 0.287837 May 26 22:01:12.618649 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1569/3168] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:01:12 2022] DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 26 22:01:12.627977 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:12.628610 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:12.634972 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.635427 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.636401 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:12.636771 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:12.766109 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:01:12.773551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c7f06e0a-464b-4f93-b812-3799cbaf23ac tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1679 microversion: 2.1 time: 0.150088 May 26 22:01:12.774112 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1600/3169] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:12 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:01:13.791370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:13.792077 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:13.799262 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:13.799717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:13.800483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:13.800957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:13.930324 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:01:13.937883 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-14726e25-3f01-4909-bef3-ce2e3a28a05c tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1679 microversion: 2.1 time: 0.150691 May 26 22:01:13.938697 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1570/3170] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:13 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:01:14.955011 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:14.956736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:14.962262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:14.962718 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:14.963486 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:14.963928 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:15.184602 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:01:15.192087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-308f1fc3-8939-472b-a879-2258a28976f9 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1679 microversion: 2.1 time: 0.241474 May 26 22:01:15.192673 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1601/3171] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:14 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:01:15.673554 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-c0d4563c-3b07-41e2-ae24-99a983a8b859 req-fc531699-2961-420b-a59d-5a61830212dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692", "name": "network-vif-deleted", "tag": "44cd339a-795e-466e-b2c7-16b1226215ff"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:01:15.682137 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-c0d4563c-3b07-41e2-ae24-99a983a8b859 req-fc531699-2961-420b-a59d-5a61830212dc service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:15.682622 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-c0d4563c-3b07-41e2-ae24-99a983a8b859 req-fc531699-2961-420b-a59d-5a61830212dc service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:15.694181 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-c0d4563c-3b07-41e2-ae24-99a983a8b859 req-fc531699-2961-420b-a59d-5a61830212dc service nova] Creating event network-vif-deleted:44cd339a-795e-466e-b2c7-16b1226215ff for instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 on hv-cinder-82880 May 26 22:01:15.699392 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-c0d4563c-3b07-41e2-ae24-99a983a8b859 req-fc531699-2961-420b-a59d-5a61830212dc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030709 May 26 22:01:15.700024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1571/3172] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:01:16.209647 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:16.210199 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:16.216661 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:16.217126 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:16.217897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:16.218839 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:16.249892 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:16.250344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:16.250802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.objects.instance [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lazy-loading 'fault' on Instance uuid fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 {{(pid=118355) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 22:01:16.291513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e692bef3e3484ebac5d1563e489e03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f08b4e75498402eb658938f61de1244', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:01:16.299886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-97f3d37a-ff2c-4658-b278-f54a3ebc667a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 200 len: 1331 microversion: 2.1 time: 0.094232 May 26 22:01:16.300454 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1602/3173] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:16 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:01:17.317387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:17.318087 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:17.324762 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:17.325219 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:17.325975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:17.326415 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:17.339228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 HTTP/1.1 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 22:01:17.341117 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:17.342595 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692'} May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:17.343487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:17.344912 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:17.346211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:17.346211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2f9e30a5-5a5f-42ba-b9b7-897de7f57d31 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 404 len: 111 microversion: 2.1 time: 0.029876 May 26 22:01:17.346211 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1572/3174] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:17 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 26 22:01:17.351166 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-97ced7b3-6961-4baf-9877-50ac4b8bf4e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '.version_select at 0x7f46c81fdc10>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:17.429767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-97ced7b3-6961-4baf-9877-50ac4b8bf4e4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-527518826" status: 202 len: 0 microversion: 2.1 time: 0.082289 May 26 22:01:17.430329 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1603/3175] 10.222.0.66 () {58 vars in 1217 bytes} [Thu May 26 22:01:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-527518826 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 22:01:19.688941 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:19.689502 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:19.695797 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:19.696238 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:19.697118 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:19.697560 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:19.710757 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 HTTP/1.1 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 22:01:19.712270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.713840 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692'} May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:19.714735 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.716353 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:19.719800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:19.719800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9a78dbba-fb82-4977-a9f2-8cb0a2a921ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 404 len: 111 microversion: 2.1 time: 0.029285 May 26 22:01:19.719800 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1573/3176] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:01:19 2022] DELETE /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:19.723103 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:19.723782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:19.730342 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:19.730794 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:19.731553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:19.731989 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:19.745449 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 HTTP/1.1 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 22:01:19.747070 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.748774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692'} May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:19.749683 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. May 26 22:01:19.751075 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:19.752364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:19.752364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d7701c01-ecdc-4422-993f-ff26263e1679 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692" status: 404 len: 111 microversion: 2.1 time: 0.030563 May 26 22:01:19.752364 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1604/3177] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:19 2022] GET /compute/v2.1/servers/fdb8eaf8-072a-4c3d-93f5-fe1c5fcfd692 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:21.005882 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:21.006361 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:21.013016 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.013468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.014209 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.014642 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.027939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 HTTP/1.1 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 22:01:21.029474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.030897 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'ca496d3c-baab-45a8-a23c-f88eec4d16d3'} May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:21.032280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.033803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.035224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:21.035224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2d98a888-9b03-4fbb-8d67-5446a76057ba tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 404 len: 111 microversion: 2.1 time: 0.028770 May 26 22:01:21.035224 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1574/3178] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:01:21 2022] DELETE /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:21.039878 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:21.040535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: ca496d3c-baab-45a8-a23c-f88eec4d16d3] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:21.047181 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.047640 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.048405 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.048869 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.061796 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 HTTP/1.1 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 22:01:21.063298 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.064863 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'ca496d3c-baab-45a8-a23c-f88eec4d16d3'} May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:21.065726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. May 26 22:01:21.067140 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.068323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance ca496d3c-baab-45a8-a23c-f88eec4d16d3 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:21.068323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-77bff550-f957-43da-aaad-441c80a71575 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3" status: 404 len: 111 microversion: 2.1 time: 0.028641 May 26 22:01:21.068323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1605/3179] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:21 2022] GET /compute/v2.1/servers/ca496d3c-baab-45a8-a23c-f88eec4d16d3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:21.073106 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:21.073633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:21.080166 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.080640 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.081401 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.081842 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.095638 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe HTTP/1.1 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 22:01:21.097169 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.098606 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': '1f68637f-abc4-4cda-8337-006a57db6ffe'} May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:21.099382 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.100443 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:21.101601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:21.101601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d5a1e4a0-e7c4-432f-9482-bc6739480fe4 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 404 len: 111 microversion: 2.1 time: 0.029334 May 26 22:01:21.101601 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1575/3180] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:01:21 2022] DELETE /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:21.106767 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:21.107375 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: 1f68637f-abc4-4cda-8337-006a57db6ffe] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:21.113719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.114164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.114915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:21.115346 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:21.128641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe HTTP/1.1 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 22:01:21.130128 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.131513 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': '1f68637f-abc4-4cda-8337-006a57db6ffe'} May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:21.132318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. May 26 22:01:21.133671 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:21.134893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance 1f68637f-abc4-4cda-8337-006a57db6ffe could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:21.134893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-e260e740-8164-4a2c-a607-23aa52d1863a tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe" status: 404 len: 111 microversion: 2.1 time: 0.028471 May 26 22:01:21.134893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1606/3181] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:21 2022] GET /compute/v2.1/servers/1f68637f-abc4-4cda-8337-006a57db6ffe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:22.402723 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:22.403236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:22.410448 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:22.410893 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:22.411646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:22.412086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:22.424996 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.wsgi [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: request: DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc HTTP/1.1 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept: application/json May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Accept-Encoding: identity May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Connection: close May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Length: 0 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Content-Type: application/json May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Host: 10.222.0.66 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Openstack-System-Scope: None May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: User-Agent: python-urllib3/1.26.9 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Id: None May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Domain-Name: None May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Identity-Status: Confirmed May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Is-Admin-Project: True May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Id: default May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Domain-Name: Default May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Role: reader,member May 26 22:01:22.426507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Roles: reader,member May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Id: default May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Domain-Name: Default May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: method: > May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: exception: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.427957 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: action_args: {'id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc'} May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:22.428802 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.430089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR nova.api.openstack.wsgi May 26 22:01:22.431419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. {{(pid=118354) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:22.431419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-6d21dbd4-1e85-4b30-87b3-c7d3100cdc18 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 404 len: 111 microversion: 2.1 time: 0.029019 May 26 22:01:22.431419 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1576/3182] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:01:22 2022] DELETE /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:01:22.436051 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:01:22.436697 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] [instance: a593d7f5-c378-4a24-a59d-53fcf2e6ffcc] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:01:22.443079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:22.443530 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:22.444287 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:01:22.444774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:01:22.458360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] HTTP exception thrown: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Request method failure captured: May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc HTTP/1.1 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij-9PcggkxxbspE27P3M85OA93yqgi7PFwjOMAeB24nvtArmfsATq4ncbFuAMzCjByzn_7tBvpysTXKX5SFPiVYV4Z4_yuhjUUWvHHhb7tyfgpkMlMcecT-qGTUGSDkxlMce2mWXxd4FSWMqkbwQ6rHHVFSF__AGrPIFEWLN_iJvCHAE May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 22:01:22.459859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_4f08b4e75498402eb658938f61de1244"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/4f08b4e75498402eb658938f61de1244"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/4f08b4e75498402eb658938f61de1244"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: 4f08b4e75498402eb658938f61de1244 May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1986040926 May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 46e692bef3e3484ebac5d1563e489e03 May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-AttachVolumeNegativeTest-1986040926-project May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.461314 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'a593d7f5-c378-4a24-a59d-53fcf2e6ffcc'} May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:01:22.462118 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. May 26 22:01:22.463416 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:01:22.464643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] Returning 404 to user: Instance a593d7f5-c378-4a24-a59d-53fcf2e6ffcc could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:01:22.464643 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-efecb6a7-b44e-49c5-affc-35a1e9c895c0 tempest-AttachVolumeNegativeTest-1986040926 tempest-AttachVolumeNegativeTest-1986040926-project] 10.222.0.66 "GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc" status: 404 len: 111 microversion: 2.1 time: 0.028982 May 26 22:01:22.465035 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1607/3183] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:01:22 2022] GET /compute/v2.1/servers/a593d7f5-c378-4a24-a59d-53fcf2e6ffcc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:02:54.592447 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:54.593344 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:02:54.776798 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d6abc0fb-2fbf-4809-ae80-52dc1e7edd55 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Action: 'create', calling method: .version_select at 0x7f46c8b92700>, body: {"keypair": {"name": "tempest-TestShelveInstance-727759157", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeVC6inYYPmBsbLovksV6dU8P4VVIKovb0Bl0aU8N0PUmndd61Pz/dkZNflYzKejR3d4gw0qKE0i+CZJs/+uW9mIM0nTfc/5bTtBvp5tqI0TdfPw4B8uDlG57/Bk2gOhg=="}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:02:54.785325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-d6abc0fb-2fbf-4809-ae80-52dc1e7edd55 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Getting quotas for project af865b094acf48e497362e4e6b45ea67. Resources: {'key_pairs'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 22:02:54.789424 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.quota [None req-d6abc0fb-2fbf-4809-ae80-52dc1e7edd55 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Getting quotas for user 6d7359adc4b24e299a2581241255174d and project af865b094acf48e497362e4e6b45ea67. Resources: {'key_pairs'} {{(pid=118354) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 22:02:54.881487 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d6abc0fb-2fbf-4809-ae80-52dc1e7edd55 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.290793 May 26 22:02:54.883285 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1577/3184] 10.222.0.66 () {60 vars in 1158 bytes} [Thu May 26 22:02:54 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:03:12.513159 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:03:12.513617 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:03:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:03:22.261714 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:22.262459 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:22.266979 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-56522546", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-727759157", "security_groups": [{"name": "tempest-secgroup-smoke-956933340"}], "networks": [{"uuid": "2d326993-4b81-4536-a8cd-a803b8534087"}], "block_device_mapping_v2": [{"uuid": "805a1720-36a1-4ba4-9430-30634e6a9452", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:03:22.378532 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.network.neutron [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] validate_networks() for [('2d326993-4b81-4536-a8cd-a803b8534087', None, None, None, None, None)] {{(pid=118355) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 26 22:03:22.837817 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Flavor limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 26 22:03:22.838248 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Image limits 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 26 22:03:22.838978 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Flavor pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 26 22:03:22.839406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Image pref 0:0:0 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 26 22:03:22.839824 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.virt.hardware [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118355) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 26 22:03:22.849604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:22.850062 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:22.850864 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:22.851309 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:22.868468 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Getting quotas for project af865b094acf48e497362e4e6b45ea67. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 26 22:03:22.872441 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.quota [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Getting quotas for user 6d7359adc4b24e299a2581241255174d and project af865b094acf48e497362e4e6b45ea67. Resources: {'ram', 'instances', 'cores'} {{(pid=118355) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 26 22:03:22.929675 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Going to run 1 instances... {{(pid=118355) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 26 22:03:22.931741 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='805a1720-36a1-4ba4-9430-30634e6a9452',volume_size=None,volume_type=None)] {{(pid=118355) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 26 22:03:23.288047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-7b88e59c-6363-4a52-becc-2ecdecb7e1b9 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.028124 May 26 22:03:23.288725 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1608/3185] 10.222.0.66 () {60 vars in 1146 bytes} [Thu May 26 22:03:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 26 22:03:23.296373 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:23.297167 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:23.301124 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78563401-e89c-4a1a-baa8-de23d5869ef2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:23.301746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78563401-e89c-4a1a-baa8-de23d5869ef2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:23.357698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78563401-e89c-4a1a-baa8-de23d5869ef2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:23.364378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78563401-e89c-4a1a-baa8-de23d5869ef2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1086 microversion: 2.1 time: 0.069628 May 26 22:03:23.364994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1578/3186] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:23 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1086 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:24.381945 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d10d391c-a7ef-4cf4-86c2-1ff537969a32 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:24.382573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d10d391c-a7ef-4cf4-86c2-1ff537969a32 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:24.437778 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d10d391c-a7ef-4cf4-86c2-1ff537969a32 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:24.444380 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d10d391c-a7ef-4cf4-86c2-1ff537969a32 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1086 microversion: 2.1 time: 0.066774 May 26 22:03:24.444986 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1609/3187] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:24 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1086 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:25.461240 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e328901d-b4ac-464e-be4d-d94efbee09ae tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:25.461793 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e328901d-b4ac-464e-be4d-d94efbee09ae tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:25.515042 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e328901d-b4ac-464e-be4d-d94efbee09ae tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:25.521749 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e328901d-b4ac-464e-be4d-d94efbee09ae tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1086 microversion: 2.1 time: 0.064466 May 26 22:03:25.522318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1579/3188] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:25 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1086 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:26.538699 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8b8cbab3-efd1-46b9-a2c1-0311aef17396 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:26.539321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8b8cbab3-efd1-46b9-a2c1-0311aef17396 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:26.591969 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8b8cbab3-efd1-46b9-a2c1-0311aef17396 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:26.599173 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8b8cbab3-efd1-46b9-a2c1-0311aef17396 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1086 microversion: 2.1 time: 0.064894 May 26 22:03:26.599736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1610/3189] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:26 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1086 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:27.615943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:27.616550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:27.622688 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:27.623162 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:27.623881 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:27.624311 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:27.684385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:27.692528 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-f7220049-45a4-476e-b9ce-52c699be774f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1136 microversion: 2.1 time: 0.081198 May 26 22:03:27.693115 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1580/3190] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:27 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1136 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:28.709876 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:28.710496 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:28.717082 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:28.717540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:28.718311 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:28.718754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:28.789821 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:28.797424 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-fde126d7-0715-4a5d-ad99-85bf501d9265 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1136 microversion: 2.1 time: 0.092093 May 26 22:03:28.798178 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1611/3191] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:28 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1136 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:29.814508 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:29.815434 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:29.822573 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:29.823029 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:29.823830 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:29.824270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:30.173033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:30.181253 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7b00dd95-d1fb-44fc-85e3-8409fa0c3bdb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1202 microversion: 2.1 time: 0.370674 May 26 22:03:30.181911 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1581/3192] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:29 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1202 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:31.199242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:31.200143 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:31.208262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:31.212276 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:31.213144 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:31.216521 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:31.419250 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:31.426129 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b17c5e6e-37ac-490f-9532-aa9dc11d21ba tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.230794 May 26 22:03:31.427209 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1612/3193] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:31 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:31.578399 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-62d8be1b-5345-4961-bb7a-8620b51896ec req-5eff5804-c11b-4a96-95b7-89e96e992df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:03:31.592876 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-62d8be1b-5345-4961-bb7a-8620b51896ec req-5eff5804-c11b-4a96-95b7-89e96e992df1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:31.593431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-62d8be1b-5345-4961-bb7a-8620b51896ec req-5eff5804-c11b-4a96-95b7-89e96e992df1 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:31.615470 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-62d8be1b-5345-4961-bb7a-8620b51896ec req-5eff5804-c11b-4a96-95b7-89e96e992df1 service nova] Creating event network-changed:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:03:31.622952 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-62d8be1b-5345-4961-bb7a-8620b51896ec req-5eff5804-c11b-4a96-95b7-89e96e992df1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048145 May 26 22:03:31.634698 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1582/3194] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:03:32.444573 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:32.445217 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:32.451641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:32.452088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:32.453053 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:32.453498 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:32.581297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:32.589559 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-3859a8eb-326e-46de-adca-32f7a082ec26 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.149389 May 26 22:03:32.590127 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1613/3195] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:32 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:33.608120 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:33.608859 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:33.615071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:33.615527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:33.616293 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:33.616770 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:33.749515 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:33.757202 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-e252c320-3eee-4454-8bfe-ee35729fc10d tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.154014 May 26 22:03:33.757764 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1583/3196] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:33 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:34.773870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:34.774520 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:34.776377 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=2 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:34.781965 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:34.782425 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:34.783194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:34.783636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:34.912707 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:34.920024 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a2952d0c-9672-45bd-abd4-9d44bf03f30a tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.150013 May 26 22:03:34.920603 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1614/3197] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:34 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:35.937371 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:35.937983 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:35.940326 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell0:SELECT=4 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:35.945823 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:35.950251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:35.950251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:35.950251 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:36.079270 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:36.086630 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-78fc10f7-5340-4a56-b817-e13768ca4edb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.153065 May 26 22:03:36.087193 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1584/3198] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:35 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:37.103202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:37.103826 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:37.106165 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell0:SELECT=10 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:03:37.111047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:37.111502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:37.112297 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:37.112769 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:37.244358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:37.252087 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d7c92179-8196-46b5-8113-d577bd03df10 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.152728 May 26 22:03:37.252656 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1615/3199] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:37 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:38.269279 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:38.269922 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:38.276942 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:38.277391 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:38.278148 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:38.278584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:38.406567 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:38.414541 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ca8f801e-2323-4a27-b98a-9600ac20dca2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.149200 May 26 22:03:38.415105 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1585/3200] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:38 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:39.431944 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:39.432556 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:39.439049 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:39.439502 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:39.440271 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:39.440871 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:39.572922 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:39.580366 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b42cfbb9-abaf-455c-a588-627a30eec2c1 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.153063 May 26 22:03:39.581017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1616/3201] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:39 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 22:03:40.597980 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:40.598597 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:40.605153 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:40.605600 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:40.606359 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:40.606799 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:40.738582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:40.746904 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-687f0547-8679-4495-8167-fe88cafca71b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.152795 May 26 22:03:40.747483 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1586/3202] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:40 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:41.763358 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:41.763975 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:41.770212 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:41.770646 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:41.772023 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:41.772458 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:41.905545 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:41.912895 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-b26bcdb8-6019-4c29-bc7c-654ee358e23c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.153388 May 26 22:03:41.913466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1617/3203] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:41 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:42.522126 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-8163665f-d6e4-43dc-94b6-fc7f8bd0d4dd req-687636ec-2f5a-4af0-a9f9-2dc8f28b90d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:03:42.530123 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-8163665f-d6e4-43dc-94b6-fc7f8bd0d4dd req-687636ec-2f5a-4af0-a9f9-2dc8f28b90d4 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:42.530568 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-8163665f-d6e4-43dc-94b6-fc7f8bd0d4dd req-687636ec-2f5a-4af0-a9f9-2dc8f28b90d4 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:42.541984 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-8163665f-d6e4-43dc-94b6-fc7f8bd0d4dd req-687636ec-2f5a-4af0-a9f9-2dc8f28b90d4 service nova] Creating event network-vif-plugged:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:03:42.546943 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-8163665f-d6e4-43dc-94b6-fc7f8bd0d4dd req-687636ec-2f5a-4af0-a9f9-2dc8f28b90d4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082479 May 26 22:03:42.547520 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1587/3204] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:03:42.929193 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:42.929818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:42.936321 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:42.936818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:42.937629 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:42.938079 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:43.062777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:43.070664 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-eb2b2398-d6d9-42be-b413-65a49e573762 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.145420 May 26 22:03:43.071231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1618/3205] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:42 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:44.088720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:44.089414 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:44.095584 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:44.096035 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:44.096813 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:44.097254 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:44.233609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:44.241176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-9069b74d-aea2-4772-9697-4ae35bee63fb tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1257 microversion: 2.1 time: 0.157674 May 26 22:03:44.241747 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1588/3206] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:44 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:45.258802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:45.259403 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:45.265919 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:45.266347 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:45.267108 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:45.267540 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:45.396692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:45.404152 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-d36dd864-673e-48e0-b390-56ae1b386a69 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1440 microversion: 2.1 time: 0.149721 May 26 22:03:45.404757 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1619/3207] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:45 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1440 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 26 22:03:45.419905 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:03:45.420522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:03:45.426951 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:45.427404 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:45.428159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:45.428605 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:45.559667 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:03:45.567321 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-48f1a3e6-2d83-4ddd-90e1-e6be3be00e40 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1440 microversion: 2.1 time: 0.151171 May 26 22:03:45.567871 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1589/3208] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:03:45 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1440 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:03:47.773642 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [req-06fd5ac7-9280-4643-a23c-932a1f894660 req-beac1a82-c143-4516-a4ae-b3a86c7af79a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:03:47.781618 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-06fd5ac7-9280-4643-a23c-932a1f894660 req-beac1a82-c143-4516-a4ae-b3a86c7af79a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:03:47.782054 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [req-06fd5ac7-9280-4643-a23c-932a1f894660 req-beac1a82-c143-4516-a4ae-b3a86c7af79a service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:03:47.792783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.compute.server_external_events [req-06fd5ac7-9280-4643-a23c-932a1f894660 req-beac1a82-c143-4516-a4ae-b3a86c7af79a service nova] Creating event network-changed:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:03:47.797809 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [req-06fd5ac7-9280-4643-a23c-932a1f894660 req-beac1a82-c143-4516-a4ae-b3a86c7af79a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085258 May 26 22:03:47.798410 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1620/3209] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:04:21.610133 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:04:21.610621 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:06:01.740000 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3184f704-9eec-4fd4-86b7-8ab9abe3b1fe] AMQP server on 10.222.0.66:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 26 22:06:01.740689 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=28 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:01.741334 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=52 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:01.745234 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:06:01.745768 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:01.751558 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:01.752271 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:01.753064 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:01.753495 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:01.776237 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lazy-loading 'flavor' on Instance uuid be617bec-fb00-425b-a898-5def27c94cb9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 22:06:02.058639 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2b2a177b-74c2-4f1b-8260-65f638f1f5b0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "POST /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.320309 May 26 22:06:02.059463 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1590/3210] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 22:06:01 2022] POST /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 22:06:02.068716 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR oslo.messaging._drivers.impl_rabbit [-] [130df3b5-ff87-4f67-8ac8-b3af6a85bbe6] AMQP server on 10.222.0.66:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 26 22:06:02.071571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:02.071571 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=58 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:02.074435 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:02.075149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:02.081183 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:02.081636 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:02.082397 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:02.082859 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:02.214060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:02.222164 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-8034c598-297a-41fd-a6a8-dde5fa20dc2f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.158449 May 26 22:06:02.222733 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1621/3211] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:02 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:03.240474 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:03.241233 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:03.248609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:03.249076 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:03.249843 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:03.250289 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:03.256378 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] [3184f704-9eec-4fd4-86b7-8ab9abe3b1fe] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 56064. May 26 22:06:03.443228 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:03.450791 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-67565302-6888-4a91-b08e-18ff511a1ce4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.215267 May 26 22:06:03.455094 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1591/3212] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:03 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:04.468254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:04.468831 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:04.481251 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] [130df3b5-ff87-4f67-8ac8-b3af6a85bbe6] Reconnected to AMQP server on 10.222.0.66:5672 via [amqp] client with port 56070. May 26 22:06:04.483382 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:04.483827 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:04.484593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:04.485032 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:04.613652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:04.621106 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a688268d-dc76-4d7b-ad54-b5408c130647 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.157202 May 26 22:06:04.621670 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1622/3213] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:04 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:05.638661 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:05.639274 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:05.645753 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:05.646207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:05.646995 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:05.647431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:05.773679 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:05.781024 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-201ced06-7e66-4ab3-8eee-02b1c703b955 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.146198 May 26 22:06:05.781582 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1592/3214] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:05 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:06.798117 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:06.798736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:06.805323 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:06.805781 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:06.806543 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:06.806982 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:06.937548 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:06.945202 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-a5211ac8-e9bc-415a-a67a-7ac87535644e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.150999 May 26 22:06:06.945774 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1623/3215] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:06 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:07.962172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:07.962700 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:07.969161 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:07.969613 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:07.970367 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:07.970804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:08.100364 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:08.107994 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3b8c8b12-07ae-439e-89a0-8d8badf26c1e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.149774 May 26 22:06:08.108553 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1593/3216] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:07 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:09.125047 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:09.125669 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:09.132453 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:09.132938 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:09.133696 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:09.134137 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:09.268604 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:09.276632 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-71b8bd03-30bf-41b8-8cc3-899cfc9d38e0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.155436 May 26 22:06:09.277194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1624/3217] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:09 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:10.293431 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:10.294050 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:10.300489 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:10.300977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:10.301744 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:10.302185 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:10.429609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:10.436965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3ff6c6f6-9339-4a5a-83e1-72fdcd667c56 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.147390 May 26 22:06:10.437526 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1594/3218] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:10 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:11.454695 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:11.455318 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:11.462327 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:11.462784 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:11.463551 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:11.463990 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:11.640225 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:11.648254 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-15f16cfb-e092-47fe-a433-dea5b6809c65 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.197445 May 26 22:06:11.648842 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1625/3219] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:11 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:11.913668 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:06:11.914176 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:06:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:06:12.665977 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:12.666593 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:12.673208 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:12.673660 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:12.674417 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:12.674854 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:13.117516 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:13.124974 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-7f8ea4f7-fcc5-480e-80a4-252fe5770e38 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.463488 May 26 22:06:13.125545 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1595/3220] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:12 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:14.142331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:14.144331 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:14.149652 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:14.150022 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:14.150783 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:14.151219 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:14.283731 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:14.291237 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c53d6134-f2bf-45df-ab0b-f493ff0da49b tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.152805 May 26 22:06:14.291814 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1626/3221] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:14 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:15.308010 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:15.308653 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:15.315089 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:15.315527 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:15.316287 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:15.316766 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:15.450856 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:15.458387 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-03b242aa-1f28-4e51-9d1b-f92ab3c84724 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.154411 May 26 22:06:15.458953 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1596/3222] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:15 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:16.475541 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:16.476726 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:16.483110 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.483553 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.484296 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.484754 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.611897 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:16.619344 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-9f5aabd3-e899-4723-8018-d66819efbd58 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1506 microversion: 2.1 time: 0.147695 May 26 22:06:16.619901 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1627/3223] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:16 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:16.635655 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:06:16.636236 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:16.642720 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.643179 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.643939 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.644384 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.952997 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-241cba05-3742-4b96-b4d6-b58527a5859c tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "POST /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9/action" status: 202 len: 0 microversion: 2.1 time: 0.321129 May 26 22:06:16.953965 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1597/3224] 10.222.0.66 () {60 vars in 1277 bytes} [Thu May 26 22:06:16 2022] POST /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 22:06:16.962663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:16.963469 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:16.970188 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.970641 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.971587 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:16.972031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:16.998656 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-d87c07fe-ae4a-44a3-85ba-7f41858fceb2 req-cb666de3-b8d9-4bbc-b600-321f800db348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "name": "network-vif-unplugged", "status": "completed", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:06:17.007877 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d87c07fe-ae4a-44a3-85ba-7f41858fceb2 req-cb666de3-b8d9-4bbc-b600-321f800db348 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:17.008407 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-d87c07fe-ae4a-44a3-85ba-7f41858fceb2 req-cb666de3-b8d9-4bbc-b600-321f800db348 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:17.020694 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.compute.server_external_events [req-d87c07fe-ae4a-44a3-85ba-7f41858fceb2 req-cb666de3-b8d9-4bbc-b600-321f800db348 service nova] Unable to find a host for instance be617bec-fb00-425b-a898-5def27c94cb9. Dropping event network-vif-unplugged {{(pid=118354) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 26 22:06:17.028030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-d87c07fe-ae4a-44a3-85ba-7f41858fceb2 req-cb666de3-b8d9-4bbc-b600-321f800db348 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026930 May 26 22:06:17.028030 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1598/3225] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 26 22:06:17.107388 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:17.115466 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c31fb3be-bef5-443e-83a4-a00c6e741a09 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1514 microversion: 2.1 time: 0.157277 May 26 22:06:17.123204 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1628/3226] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:16 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:18.132550 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:18.133267 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:18.139717 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:18.140173 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:18.140975 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:18.141422 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:18.278609 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:18.287168 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-08543ca7-6c5e-4fd4-a67e-12e3e62eea98 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1516 microversion: 2.1 time: 0.158481 May 26 22:06:18.287746 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1599/3227] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:18 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:18.877719 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:06:18.878238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:06:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:06:19.304911 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:19.305523 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:19.312510 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:19.313594 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:19.313841 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:19.314274 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:19.443376 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:19.451663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-61cc9217-e9e4-44e9-bc9d-ac430fba1415 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1516 microversion: 2.1 time: 0.150638 May 26 22:06:19.452231 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1629/3228] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:19 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:20.469037 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:20.469687 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:20.476086 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:20.476542 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:20.477339 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:20.478284 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:20.616731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:20.624963 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-d4cfa9fc-18f9-4f6f-8aff-a5a08a1c4a24 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.159910 May 26 22:06:20.625544 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1600/3229] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:20 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:21.642917 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:21.643535 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:21.650579 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:21.651033 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:21.651792 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:21.652238 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:21.784593 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:21.792931 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-ac5d8cc9-8eb6-4f3c-bcc2-6aa7dd8bd4da tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.153691 May 26 22:06:21.793492 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1630/3230] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:21 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:22.810708 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:22.811241 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:22.817804 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:22.818260 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:22.819022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:22.819468 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:22.949057 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:22.956644 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bbe15f96-d002-41df-bd67-72f81bbbccee tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.150406 May 26 22:06:22.957215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1601/3231] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:22 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:23.973692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:23.974244 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:23.980672 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:23.981130 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:23.981913 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:23.982351 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:24.116808 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:24.124900 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-de05ea1b-5240-49c8-825a-907e024cb50f tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.155215 May 26 22:06:24.125462 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1631/3232] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:23 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:25.142902 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:25.143507 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:25.150571 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:25.151022 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:25.151776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:25.152215 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:25.284650 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:25.292075 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-2015ef59-ccf3-4646-8535-31501a6659a0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.153101 May 26 22:06:25.292719 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1602/3233] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:25 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:26.309089 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:26.309692 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:26.316261 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:26.316736 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:26.317483 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:26.317915 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:26.443890 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:26.451893 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-bec39523-3cd7-4ec4-86f9-9e61ada3394e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.146662 May 26 22:06:26.452464 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1632/3234] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:26 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:27.469159 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:27.469777 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:27.476318 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:27.476916 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:27.477727 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:27.478683 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:27.613308 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:27.620646 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-32fdeaab-9f5c-46ee-a774-ab44eb7a7921 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.155400 May 26 22:06:27.621212 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1603/3235] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:27 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:28.638833 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:28.639437 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:28.646485 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:28.646976 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:28.647790 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:28.648227 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:28.778995 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:28.786360 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-2b04be50-973a-4484-a712-b143a24082fd tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.152099 May 26 22:06:28.790013 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1633/3236] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:28 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:29.803379 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:29.803959 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:29.810438 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:29.813936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:29.813936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:29.813936 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:29.816125 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:29.940402 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:29.947878 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-1848eacb-6649-4a7a-8136-08b712687684 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.148499 May 26 22:06:29.948444 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1604/3237] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:29 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:30.964723 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:30.965262 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:30.971914 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:30.972368 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:30.973149 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:30.973591 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:31.106777 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:31.114293 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-69051707-c4c6-482a-b01a-d38c3c271632 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.153523 May 26 22:06:31.114870 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1634/3238] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:30 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:31.128183 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-5a6f0cfe-ee0d-40fc-8fe1-6b22a3175f91 req-a0036a1f-6d1f-47a1-bf85-72fdb93186f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "name": "network-vif-plugged", "status": "completed", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:06:31.136731 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-5a6f0cfe-ee0d-40fc-8fe1-6b22a3175f91 req-a0036a1f-6d1f-47a1-bf85-72fdb93186f8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:31.137178 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-5a6f0cfe-ee0d-40fc-8fe1-6b22a3175f91 req-a0036a1f-6d1f-47a1-bf85-72fdb93186f8 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:31.147543 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-5a6f0cfe-ee0d-40fc-8fe1-6b22a3175f91 req-a0036a1f-6d1f-47a1-bf85-72fdb93186f8 service nova] Creating event network-vif-plugged:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:06:31.152724 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-5a6f0cfe-ee0d-40fc-8fe1-6b22a3175f91 req-a0036a1f-6d1f-47a1-bf85-72fdb93186f8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028437 May 26 22:06:31.153307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1605/3239] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:06:32.131638 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:32.132264 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:32.138932 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:32.139390 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:32.140150 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:32.140609 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:32.155701 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=87 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:32.273457 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:32.281450 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-c5ca2dd7-aea8-40e2-8dec-71691c7feb2e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1572 microversion: 2.1 time: 0.153747 May 26 22:06:32.282017 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1635/3240] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:32 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:06:32.522059 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:06:32.522245 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:06:32.809007 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:06:32.809195 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:06:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:06:33.299207 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:06:33.299918 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:06:33.302325 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=35 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:06:33.307555 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:33.308014 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:33.308866 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:06:33.309307 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:06:33.439982 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:06:33.447691 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-ea31df32-c1bf-4b71-87d0-fadb3b978dc4 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1559 microversion: 2.1 time: 0.152970 May 26 22:06:33.448263 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1606/3241] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:06:33 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:08:00.279314 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_api:SELECT=1 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:00.281196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:00.281196 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:00.281685 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG dbcounter [-] [118354] Writing DB stats nova_cell1:SELECT=12 {{(pid=118354) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:00.284031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_api:SELECT=30 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:00.284840 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG dbcounter [-] [118355] Writing DB stats nova_cell1:SELECT=3 {{(pid=118355) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 22:08:00.286306 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-0b361743-99ff-47e1-87da-0bfe306004bd req-d50596f8-e21f-4ab6-8e6d-a5cb8c2546bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:08:00.290711 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:00.291316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:00.292412 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:00.292886 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:00.295874 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-0b361743-99ff-47e1-87da-0bfe306004bd req-d50596f8-e21f-4ab6-8e6d-a5cb8c2546bf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:00.296385 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-0b361743-99ff-47e1-87da-0bfe306004bd req-d50596f8-e21f-4ab6-8e6d-a5cb8c2546bf service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:00.310352 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-0b361743-99ff-47e1-87da-0bfe306004bd req-d50596f8-e21f-4ab6-8e6d-a5cb8c2546bf service nova] Creating event network-changed:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:08:00.316482 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-0b361743-99ff-47e1-87da-0bfe306004bd req-d50596f8-e21f-4ab6-8e6d-a5cb8c2546bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038697 May 26 22:08:00.328948 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Going to try to terminate instance {{(pid=118355) delete /opt/stack/nova/nova/compute/api.py:2664}} May 26 22:08:00.329761 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1607/3242] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:08:00.598925 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0a72340d-a57a-49e5-ae9d-c1477d40545e tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "DELETE /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 204 len: 0 microversion: 2.1 time: 0.323257 May 26 22:08:00.600395 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1636/3243] 10.222.0.66 () {58 vars in 1238 bytes} [Thu May 26 22:08:00 2022] DELETE /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 26 22:08:00.610546 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:00.611774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:00.618628 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:00.619396 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:00.620561 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:00.621398 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:00.759066 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:08:00.766705 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-bd0a4c73-d317-47b7-a80c-2a45bbb781e8 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.161509 May 26 22:08:00.767280 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1608/3244] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:08:00 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:08:01.784301 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:01.785060 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:01.791554 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:01.792012 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:01.792818 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:01.793268 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:01.924460 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:08:01.932002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-0f87e011-e821-4985-928f-8a7dcc9ccc02 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1565 microversion: 2.1 time: 0.152503 May 26 22:08:01.932567 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1637/3245] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:08:01 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:08:02.904895 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [req-9020269d-4404-4d29-983e-3c899a582cb5 req-b3ff1445-d3aa-4abb-83f2-36fc4b8059f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be617bec-fb00-425b-a898-5def27c94cb9", "name": "network-vif-deleted", "tag": "ea5cd005-b775-46e3-9a46-b8ca84657236"}]} {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 26 22:08:02.914313 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-9020269d-4404-4d29-983e-3c899a582cb5 req-b3ff1445-d3aa-4abb-83f2-36fc4b8059f3 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:02.914803 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [req-9020269d-4404-4d29-983e-3c899a582cb5 req-b3ff1445-d3aa-4abb-83f2-36fc4b8059f3 service nova] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:02.927370 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.compute.server_external_events [req-9020269d-4404-4d29-983e-3c899a582cb5 req-b3ff1445-d3aa-4abb-83f2-36fc4b8059f3 service nova] Creating event network-vif-deleted:ea5cd005-b775-46e3-9a46-b8ca84657236 for instance be617bec-fb00-425b-a898-5def27c94cb9 on hv-cinder-82880 May 26 22:08:02.932715 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [req-9020269d-4404-4d29-983e-3c899a582cb5 req-b3ff1445-d3aa-4abb-83f2-36fc4b8059f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084074 May 26 22:08:02.933302 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1609/3246] 10.222.0.66 () {64 vars in 1317 bytes} [Thu May 26 22:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 26 22:08:02.949823 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:02.950445 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:02.957546 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:02.958002 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:02.958802 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:02.959242 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:03.022782 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.policy [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118355) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:08:03.030682 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-f18f3964-b087-49dd-b46e-7696d54161d2 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1379 microversion: 2.1 time: 0.084742 May 26 22:08:03.031280 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1638/3247] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:08:02 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1379 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:08:04.047774 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:04.049003 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.compute.api [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118354) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:04.055718 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:04.056172 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:04.056986 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:04.057430 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:04.087617 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:04.088071 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG oslo_concurrency.lockutils [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118354) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:04.088522 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.objects.instance [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lazy-loading 'fault' on Instance uuid be617bec-fb00-425b-a898-5def27c94cb9 {{(pid=118354) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 26 22:08:04.129890 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.policy [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d7359adc4b24e299a2581241255174d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af865b094acf48e497362e4e6b45ea67', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118354) authorize /opt/stack/nova/nova/policy.py:199}} May 26 22:08:04.137258 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-adf9f833-bd7d-4ed7-afd4-a0e70c5d4a62 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 200 len: 1222 microversion: 2.1 time: 0.093625 May 26 22:08:04.137821 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1610/3248] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:08:04 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 1222 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 26 22:08:05.154389 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '>' {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:05.155010 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.compute.api [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] [instance: be617bec-fb00-425b-a898-5def27c94cb9] Fetching instance by UUID {{(pid=118355) get /opt/stack/nova/nova/compute/api.py:2920}} May 26 22:08:05.161094 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:05.161547 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:05.162303 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 26 22:08:05.162742 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG oslo_concurrency.lockutils [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Lock "97faeabc-1cd1-4d3b-8b75-7848ba9e27ca" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118355) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 26 22:08:05.180428 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.wsgi [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] HTTP exception thrown: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Request method failure captured: May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: request: GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 HTTP/1.1 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept: application/json May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Accept-Encoding: identity May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Connection: close May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Length: 0 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Content-Type: application/json May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Host: 10.222.0.66 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Openstack-System-Scope: None May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: User-Agent: python-urllib3/1.26.9 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Auth-Token: gAAAAABij_kI0UJjRU9fRRJfO0rzNkB2uf30-cZZaHx7SrdL2wrBPwfShT9Apt3icWO-ua-3f0KZRBBDosRl1XGVnd-Sz09YnrVREQ_dehG0ktWMOcVWfowL2qO__YC8sZVm39-JplXR8BUYlETz2RlGJydhVLpsDO_FJwMHJJ2Dg0fW3V1ygUU May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Id: None May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Domain-Name: None May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Identity-Status: Confirmed May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Is-Admin-Project: True May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Id: default May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Domain-Name: Default May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Id: af865b094acf48e497362e4e6b45ea67 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Project-Name: tempest-TestShelveInstance-1257287345 May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Role: reader,member May 26 22:08:05.182088 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Roles: reader,member May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/af865b094acf48e497362e4e6b45ea67"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_af865b094acf48e497362e4e6b45ea67"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/af865b094acf48e497362e4e6b45ea67"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/af865b094acf48e497362e4e6b45ea67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}] May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant: tempest-TestShelveInstance-1257287345 May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Id: af865b094acf48e497362e4e6b45ea67 May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-Tenant-Name: tempest-TestShelveInstance-1257287345 May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User: tempest-TestShelveInstance-1257287345-project May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Id: default May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Domain-Name: Default May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Id: 6d7359adc4b24e299a2581241255174d May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: X-User-Name: tempest-TestShelveInstance-1257287345-project May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: method: > May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: exception: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. May 26 22:08:05.183663 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: action_args: {'id': 'be617bec-fb00-425b-a898-5def27c94cb9'} May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: {{(pid=118355) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 26 22:08:05.184633 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. May 26 22:08:05.186097 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: ERROR nova.api.openstack.wsgi May 26 22:08:05.187406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: DEBUG nova.api.openstack.wsgi [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Returning 404 to user: Instance be617bec-fb00-425b-a898-5def27c94cb9 could not be found. {{(pid=118355) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 26 22:08:05.187406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO nova.api.openstack.requestlog [None req-6188eb70-11f2-4b1c-a1dc-53d6b718a5c0 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9" status: 404 len: 111 microversion: 2.1 time: 0.033144 May 26 22:08:05.187406 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: [pid: 118355|app: 0|req: 1639/3249] 10.222.0.66 () {58 vars in 1235 bytes} [Thu May 26 22:08:05 2022] GET /compute/v2.1/servers/be617bec-fb00-425b-a898-5def27c94cb9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 26 22:08:05.432038 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: DEBUG nova.api.openstack.wsgi [None req-3658bcc2-4e9b-4898-a31b-583ad5aec656 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] Calling method '.version_select at 0x7f46c842a040>' {{(pid=118354) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 26 22:08:05.530333 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO nova.api.openstack.requestlog [None req-3658bcc2-4e9b-4898-a31b-583ad5aec656 tempest-TestShelveInstance-1257287345 tempest-TestShelveInstance-1257287345-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-727759157" status: 202 len: 0 microversion: 2.1 time: 0.102375 May 26 22:08:05.530914 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: [pid: 118354|app: 0|req: 1611/3250] 10.222.0.66 () {58 vars in 1250 bytes} [Thu May 26 22:08:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-727759157 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 26 22:09:21.620131 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:09:21.620776 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:09:38.886687 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:09:38.887265 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:09:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:09:52.529980 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:09:52.530583 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:09:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:11:11.923442 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:11:11.924009 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:11:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:11:20.000033 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:11:20.000633 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:11:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:12:41.628809 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:12:41.629454 dv-cinder-828807-3-iscsi devstack@n-api.service[118354]: Thu May 26 22:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:12:58.894788 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:12:58.895316 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:13:12.538619 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:13:12.539180 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 26 22:13:12.820031 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 26 22:13:12.820194 dv-cinder-828807-3-iscsi devstack@n-api.service[118355]: Thu May 26 22:13:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!